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DATA TRANSFER AND SYNCHRONIZATION SYSTEM 

INVENTOR: 
David L. Multer 

Limited Copyright Waiver 

A portion of the disclosure of this patent document contains material 
to which the claim of copyright protection is made. The copyright owner 
5 has no objection to the facsimile reproduction by any person of the patent 
document or the patent disclosure, as it appears in the U.S. Patent and 
Trademark Office file or records, but reserves all other rights whatsoever 

BACKGROUND OF THE INVENTION 
10 Field of the Invention 

The invention relates to the transference of data between two 
systems independent of the form in which the data is kept on the 
respective systems, and in particular to providing an efficient means of 
communicating data between systems and devices. 

15 

Description of the Related Art 

The growth of computing-related devices has not been limited to 
personal computers or work stations. The number of personal computing 
devices has grown substantially in both type and format. Small, hand-held 

20 computers carry a multitude of contact, personal, document, and other 
information and are sophisticated enough to allow a user to fax, send e- 
mails, and communicate in other ways wirelessly. Even advanced cellular 
phones carry enough memory and processing power to store contact 
information, surf the web, and provide text messaging. Along with the 

25 growth in the sophistication of these devices, the need to transfer 
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information between them has grown significantly as well. 

With a multitude of different device types on the market, keeping 
information between the different devices synchronized has become 
increasingly problematic. For example, if an individual keeps a calendar 
of information on a personal computer in his or her office using a particular 
personal information manager application, the individual would generally 
like to have the same information available in a cellular phone, hand-held 
organizer, and perhaps a home personal computer. The individual may 
additionally have a notebook computer which requires synchronizing file 
data such as presentations or working documents between the notebook 
and the office computer. 

Until now, synchronization between both documents and personal 
information managers has occurred through direct connection between the 
devices, and generally directly between applications such as a personal 
information manager in one device and a personal information manager in 
another device or using an intermediary sync-mapping program. 

One example of this is the prevalent use of the 3Com Palm® OS- 
based organizer, such as the 3Com Palm® series of computing devices, 
which uses its own calendaring system, yet lets users synchronize the data 
therein with a variety of different personal information manager software 
packages, such as Symantec's ACT!™, Microsoft's Outlook®, and other 
systems. In this example, an intermediary synchronization program such 
as Puma Technology, Inc.'s Intellisync® is required. Intellisync® is an 
application program which runs on both the hand-held device and the 
computer which stores the information data and maps data systems 
between non-uniform data records. In other cases, direct transfer between 
applications such as transfer between Microsoft's Outlook® computer- 
based client and Microsoft's Windows CE "Pocket Outlook" application, is 
possible. Nevertheless, in both cases, synchronization occurs through 
direct connection between a personal computer and the personal 
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computing device. While this connection is generally via a cable directly 
connecting, for example, Palm® device in a cradle to the personal 
computer, the connection may be wireless as well. 

One component of these synchronization systems is that the 
5 synchronization process must be able to delineate between when changes 
are made to specific databases and must make a decision about whether 
to replace the changed field. Normally, this is measured by a change in 
one database, and no-change in a second database. In some cases, both 
databases will have changed between syncs. In this case, the sync 
1 0 operation must determine which of the two changes which has been made 
is to "win" and replace the other during the sync. Generally, this 
determinant of whether a conflict exists allows some means for letting the 
user resolve the conflict. 

In a technical sense, synchronization in this manner is generally 
15 accomplished by the copying of full records between systems. At some 
level, a user is generally required to map data fields from one application 
to another and specify which data fields are assigned to which 
corresponding field in a different device. Less mapping is required where 
developers more robustly support various platforms of applications. 
20 In many instances, the data to be synchronized is generally in the 

form of text data such as records of addresses, contact information, 
calendar information, notes and other types of contact information. In 
certain instances, data to be synchronized will be binary format of 
executable files or word processor-specific documents. In many cases 
25 where document synchronization is required, the synchronization routine 
simply determines whether or not the documents in question have 
changed, and uses a time-based representation to determine which of the 
two files is newer, and replaces the older file with the newer file to achieve 
synchronization, as long as the older of the two files was in fact not 
30 changed. This is the model used in the familiar "Briefcase" function in 
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Microsoft Windows-based systems. If both files have changed, then the 
synchronization routine presents the option of conflict resolution to the 
user. 

Such synchronization schemes are generally relatively inefficient 
since they require full band-width of the document or binary file to be 
transferred via the synchronization link. In addition, at some level the 
synchronization programs require interaction by the user to map certain 
fields between different programs. 

One of the difficulties in providing synchronization between different 
computing devices is that the applications and platforms are somewhat 
diverse. 

Nevertheless, all synchronization programs generally require certain 
functions in order to be viable for widespread usage. In particular, 
synchronization programs must work with popular applications on various 
platforms. Sync applications must allow for conflicts resolution when 
changes are made to the same information on different devices between 
syncing events. They must provide synchronization for all types of formats 
of data, whether it be text data in the form of contacts, e-mails, calendar 
information, memos or other documents, or binary data in the form of 
documents or programs in particular types of formats. 

In a broader sense, applications which efficiently synchronize data 
between disparate types of devices can provide advantages in applications 
beyond synchronizing individual, personal information between, for 
example, a personal information manager hardware device such as a 
Palm® computing device, and a personal computer. The same objectives 
which are prevalent in developing data transfer between personal 
information management (PIM) devices and desktop systems lend 
themselves to furthering applications requiring data transfer between other 
types of devices, on differing platforms. These objectives include speed, 
low bandwidth, accuracy, and platform independence. 
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For example, current e-mail systems use a system which is 
somewhat akin to the synchronization methods used for disparate devices 
in that an entire message or file is transferred as a whole between different 
systems. When a user replies to an e-mail, generally the entire text of the 
5 original message is returned to the sender, who now has two copies of the 
e-mail text he/she originally sent out. The same is true if an e-mail 
attachment is modified and returned. All of the text which is the same 
between both systems is essentially duplicated on the originator's system. 

10 SUMMARY OF THE INVENTION 

The invention comprises a system and method for efficiently, quickly 
and easily synchronizing devices which can couple to the Internet, or any 
network. Synchronization of the devices can occur at independent times 
using an intervening network based storage server to store changes to 

15 data for all the different devices in the system in a data independent 
format, and provide the data on request to the device requesting a sync at 
the time requested. Hence, two devices need not be coupled to each other 
to perform a sync. 

In one aspect the invention comprises a system for synchronizing 

20 data between a first system and a second system. The system includes 
a first sync engine on the first system interfacing with data on the first 
system to provide difference information. A data store is coupled to 
network and in communication with the first and second systems. A 
second sync engine is provided on the second system coupled to receive 

25 the difference information from the data store via the network, and 
interfacing with data on the second system to update said data on the 
second system with said difference information. 

Difference information is transmitted to the data store by the first 
sync engine and received from the data store from the second sync 

30 engine. The difference information is transmitted to the data store at a first 
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point in time, and received from the data store at a second, subsequent 
point in time. In a further aspect, the second sync engine can interface 
with said data on the second system to provide second difference 
information to the data store and the first sync engine may thereafter 
5 couple to the data store to retrieve the second difference information and 
interface with the data on the first system to update said data on the first 
system with said second difference information. 

The system may include a management server coupled to the 
network and in communication with the first sync engine, the second sync 

1 0 engine and the data store. 

In a further aspect, the system may include a first device, coupled 
to the first system via the network, providing said data to the first system. 
In such instance, the first system may be a sync server. 

The system may include a plurality of sync engines on a respective 

15 plurality of systems, each of said plurality of engines being coupled to 
receive difference information from each of said first, second and plurality 
of sync engines from the data store via the network. Each said engine 
interfaces with data on the system on which it resides to update said data 
on said system on which it resides with said difference information, and 

20 interfaces with data on said system on which it resides to provide 
difference data information from the system on which it resides to the data 
store. 

In a further embodiment, the invention comprises a system including 
a first device, a data store and a second device. The first device includes 

25 at least a first data file and first differencing code having an input and an 
output coupled to a network to receive first device data change 
transactions, based on said at least one data file, from and provide change 
transactions to, said network. The data store is coupled to the network 
and has at least one data structure coupled to store change transactions. 

30 The second device includes at least a second data file and second 
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differencing code having an input and an output coupled to the network to 
receive said first device data change transactions, and provide second 
change transactions based on said at least second data file to said data 
store. 

In a further embodiment, the invention comprises a method for 
synchronizing at least a first and a second resident on a first and a second 
systems, respectively, coupled to the Internet, respectively. The method 
includes the steps of: determining difference data resulting from changes 
to the first file on the first system; transmitting the difference data to a 
server via the Internet; querying the server from a second system to 
determine whether difference data exists for files on the second system; 
retrieving the difference data to the second system; and updating the 
second file on the second system with the difference data. 

In a still further aspect, the invention comprises an Internet 
synchronization system. The system includes a storage server having an 
Internet connection; a first device coupled to the Internet and including a 
device sync engine; and a second device coupled to the Internet and 
including a second device sync engine. A management server may further 
be provided. In this aspect, each device sync engine may comprise an 
application object, an application object store, and a delta engine. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will be described with respect to the particular 
embodiments thereof. Other objects, features, and advantages of the 
invention will become apparent with reference to the specification and 
drawings in which: 

Figures 1 - 7 are block diagrams of various configurations of the 
system of the present invention utilizing the differencing routines of the 
present invention. 

Figure 8 is an overview of one embodiment of the system 
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architecture in accordance with the present invention. 

Figure 9A is a block diagram of the desktop device engine of the 
present invention. 

Figure 9B is a block diagram of the configuration of server side 
5 device engines utilized in accordance with the present invention. 

Figure 10 is a block diagram of one embodiment of the device 
engine in an operating system such as Windows. 

Figure 11 is a block diagram of an application object incorporated 
into the device engine of the present invention. 
10 Figure 12 is a diagram of storage object hierarchy of a universal 

data format utilized with the system of the present invention. 

Figure 13 is a listing of exemplary item objects used in accordance 
with the routines of the present invention. 

Figure 14 is a block diagram of a management storage server 
1 5 architecture for used in the system of the present invention. 

Figure 15 is a flow diagram illustrating a pull synchronization in 
accordance with the system of the present invention. 

Figure 16 is a flow diagram illustrating a push synchronization in 
accordance with the system of the present invention. 
20 Figure 17 is a diagram of the management server architecture in 

accordance with the present invention. 

DETAILED DESCRIPTION 
The present invention includes a system and a method for 
25 transferring data between two devices which require information to be 
shared between them. In accordance with the discussion herein, a 
"device" is defined as a collection of elements or components organized 
for a common purpose, and may include hardware components of a 
computer system, personal information devices, hand-held computers, 
30 notebooks, or any combination of hardware which may include a processor 
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and memory which is adapted to receive or provide information to another 
device; or any software containing such information residing on a single 
collection of hardware or on different collections of hardware. Such 
software might include applications such as personal information 
5 managers, which include contact data and other such information, e-mail 
systems, and file systems, such as those utilized by Microsoft Windows NT 
operating systems, Unix operating systems, Linux operating systems, or 
other systems capable of storing file types having binary formats which 
translate to application formats of differing types. 

10 In one embodiment, the invention comprises a set of programs 

specifically designed to transmit and/or receive differencing data from one 
device to another device, irrespective of the type of file system, data, 
content, or system hardware configuration. 

In a further aspect, the system comprises store and forward 

15 technology which utilizes the differencing technology to implement 
services via a public or private network, such as the Internet. 

The system of the present invention finds particular usages in 
synchronizing personal contact information between different systems, but 
it will be readily apparent to one of average skill in the art that the present 

20 invention provides advantages having broader applicability than merely 
synchronizing various types of systems. For example, replying and 
forwarding e-mail can be made more efficient by forwarding only the 
differences in e-mails between systems. As a further example, updates to 
systems software via a network can be made more efficient where, for 

25 example, instead of completely replacing different modules of an 
application, only the differences of the modules need be forwarded, 
resulting in more efficient use of existing bandwidth. 

System Overview 

30 Figures 1 -7 show various configuration alternatives of the present 
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invention. 

Figure 1 shows an embodiment of the present invention in a basic 
configuration. In Figure 1, a first system or device, system A, and a 
second system or device, system B, are coupled by a communication line 
110. It should be readily understood that communication line may be any 
direct coupling of the two systems which allows data to pass between the 
systems such as, for example, by means of serial ports, parallel ports, an 
Ethernet connection or other type of network, or an infrared link, or the like. 
System A includes a functional block 100 representing a differencing 
transmitter in accordance with the present invention. System B includes 
a functional block 1 02 representing the differencing receiver in accordance 
with the present invention. 

The differencing transmitter 100, upon receipt of a control signal 
enabling operation of the transmitter, examines a specified data structure 
of information which is to be transmitted to system B. Differencing 
transmitter 1 00 extracts such information from System A and converts the 
information extracted into difference information A. Difference information 
A comprises only the changes to System B's data which have occurred on 
System B and instructions for implementing those changes. Hence, if the 
data to be transferred is a change to a file which exists on system B, 
difference information A comprises only the differences in such file and 
where such differences occur. If the data does not exist at all on System 
B, the difference information A will be the entire file. Difference information 
A received by differencing receiver 102 at System B is reconstructed at 
System B, and the changes reflected therein are updated on System B. 

For example, if System A and System B are two computers and an 
update for certain binary files on System A is required, the differencing 
transmitter on System A will extract the differences in the file known to 
exist on System B and any new files, and transmit only those differences 
(an instructions for where to insert those differences) to the differencing 
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receiver 102. Differencing receiver 102 will interpret the difference 
information (A) and reconstruct the binary files on System B. In this 
manner, the information on System B is updated without the need to 
transfer the entire binary files between the Systems. 

5 Figure 2 shows a second example of the system of the present 

invention. In Figure 2, both System A and System B include functional 
blocks 104, each representing a differencing synchronizer. The function 
of the synchronizer 104 is similar to that of the transmitter and receiver 
combined; the synchronizer will allow difference information A to be both 

1 0 transmitted and received. For example, System A and System B are a 
portable computer and a desktop computer, respectively, where 
information such as contact information needs to be synchronized between 
the two, the differencing synchronizer 1 04 will extract changes made to the 
contact information on either System A or System B and at predetermined 

1 5 times, transmit the information A between the systems, and reconstruct the 
data on the receiving system to update information from the sending 
system, in order to ensure that both systems contain the same data. 

Figure 3 shows yet another alternative embodiment of the system 
of the present invention. In Figure 3, System A again includes a 

20 differencing transmitter and System B includes a differencing receiver 1 02. 
In this embodiment, a storage server 300 is coupled between System A 
and System B. Storage server 300 may store a separate database of the 
difference information A provided by System A, which allows System A to 
provide its difference information A to the storage server 300 at a first point 

25 in time, and storage server 300 to provide the same difference information 
A to System B at a second point in time, but not the same as the first point 
in time. In addition, multiple sets of difference information A may be 
provided at different points in time, and stored for later retrieval by System 
B. Still further, the difference information sets may be maintained on 

30 server 300 to allow data on either System A or System B to be returned to 

Attorney Docket No.: FUSN1-01002USO 
Iev/fusn1/1 002.001 .wpd 



-12- 



a previous state. 

Once again, the storage server 300 is coupled by a direct 
connection 110 to both System A and System B. Storage server 300 may 
be a server specifically adapted to receive differencing information A from 
5 the receiver 1 00 and provide it to the transmitter 1 02. In one embodiment, 
server 300 includes specific functional routines for enabling this transfer. 
Alternatively, server 300 comprises standard information server types 
which respond to standard Internet communication protocols such as file 
transfer protocol (FTP), or hypertext transfer protocol (HTTP). 

1 0 Figure 4 shows yet another alternative embodiment of the system 

of the present invention wherein System A and System B, once again 
coupled directly to a storage server 300 by a direct connection line 110, 
each include a differencing synchronizer 104. Difference information A 
can be passed to and from System A through synchronizer 1 04 to and from 

1 5 the storage server 300 at a first point in time, and to and from System B at 
a second point in time. In this embodiment, storage server 300 may 
include routines, described below, for resolving conflicts between data 
which has changed on both System A and System B independently after 
the last point in times when the systems were synchronized. 

20 Figure 5 shows yet another alternative embodiment of the present 

invention including four systems: System A which includes a differencing 
synchronizer 104; System B which includes a differencing receiver 102; 
System C which also includes a differencing synchronizer 1 04; and System 
D which includes a differencing transmitter 100. Each is directly coupled 

25 to a storage server 300, allowing control of transmission of differencing 
data A between the various systems. Server 300 may include routines, 
described in further detail below, to track the various types of systems 
which comprise System A through System D, and which control the 
transmission of various components of the difference information A to each 

30 of the various systems. For example, since System B includes only 
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differencing receiver 102, the difference information A 2 which is provided 
to it may be a sub-component of that which is transferred between System 
A in the storage server 300, or may be simply receiving broadcast 
information A 4 from System D. In one embodiment of the system of the 
present invention, server 300 does not itself route the difference 
information derived from each receiver/transmitter/synchronizer. Server 
300 acts as a repository for the information, and the determination of which 
difference information A is attributed to which receiver/transmitter/ 
synchronizer is made by each receiver/transmitter/synchronizer. 

Figure 6 shows yet another alternative embodiment of the present 
invention. In Figure 6, a synchronizer is provided in storage server 300. 
It should be recognized that a forwarder and/or receiver may be provided 
in server 300 as well. The particular embodiment shown herein may be 
advantageous where device processing power and memory are limited, 
such as cases where the device is a cell phone. It should be noted that 
the data transferred between system A and the device engine 1 04a in such 
an embodiment may or may not be difference information, depending on 
whether System A has the capacity to detect and output difference 
information. Each of the devices may include a differencing receiver, a 
differencing transmitter, or a differencing synchronizer. It should be 
understood that a portion of the differencing synchronizer 1 04a may reside 
on System A and another portion may reside on server 300. 

Figure 7 shows yet another alternative embodiment of the present 
invention wherein the devices shown in Figure 6 may be coupled to a 
combination of public or private networks 700 such as, for example, the 
Internet. The network 700 may include one or more storage servers 
300^3002, and in such cases the difference information A transmitted 
between each such device 602-61 0 via intermediate storage on one of 
such servers. Network 700 may couple the devices to one or more 
specialized function servers, such as servers specifically designed to 
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include a differencing forwarder, receiver or synchronizer. Such devices 
may comprise, by way of example and without limitation, a personal office 
PC 602, a smart telephone 604, a user's office PC 606, a personal 
information Palm® computing device 608, a telephone or cellular phone 
604, a home personal computer 606, or a web browser 610. Each 
differencing receiver, differencing transmitter, or differencing synchronizer 
present in devices 602-610 includes means to poll the data stored on 
storage servers 300^ 3002 to determine whether the data present at 
storage server 300^3002 includes difference information which the 
particular receiver or synchronizer is required to have to synchronize the 
data on the device on which it resides. 

In the following description, an embodiment wherein the differencing 
receiver, transmitter, and synchronizer are described will be discussed 
with respect to its use in synchronizing contact information, calendar 
information, and binary file information between a plurality of different 
devices in the context of data synchronization. It will be readily understood 
that the system of the present invention is not limited to synchronization 
applications, or applications dependent upon specific types of data, such 
as contact information or scheduling information. In particular, it will be 
readily understood that the transmission of data comprising only the 
differences in data between two systems via routines which extract the 
data and reassemble data on the various systems, represents a significant 
advancement in the efficient transmission of data. The present invention 
allows for optimization in terms of a reduction in the bandwidth utilized to 
transmit data between two systems, since only changes to data are 
transferred. This consequently increases the speed at which such 
transactions can take place since the data which needs to be transmitted 
is substantially smaller than it would be were entire files transferred 
between the systems. 

In a particular embodiment of the present invention, the ability of 
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devices to connect to the Internet is leveraged to manage data transfer 
between the systems. In essence, each particular device which requires 
information access which can connect to the Internet may become part of 
the system of the present invention, and synchronize its data with other 
5 devices defined by a user as being part of the system. 

Generally, the system comprises client software which provides the 
functions of the differencing transmitter 1 00, differencing receiver 1 02, and 
differencing synchronizer 1 04 in the form of a device engine. The device 
engine includes at least one component particular to the type of device on 

1 0 which the device engine runs, which enables extraction of information from 
the device and conversion of the information to difference information, and 
transmission of the difference information to the storage server. This 
allows the replication of information across all systems coupled to the 
system of the present invention. Although the storage servers 300 utilized 

1 5 in the system of the present invention may be any type of storage server, 
such as an Internet server or an FTP server, and may be provided from 
any source, such as any Internet service provider (ISP), particular aspects 
of a storage server which may be useful and which may be customized to 
optimize transfer of information between systems coupled as part of the 

20 present invention will be described below. Synchronization of devices 
utilizing the synchronization system of the present invention is possible as 
long as an Internet connection between the devices is available. 

In a key aspect of the invention, the Internet connection between 
the devices or between the devices and a server, need not exist at the 

25 same point in time, and new devices may be added to the system of the 
present invention at any point in time without the loss of information. The 
system provides totally transparent access to information and the device 
engine on each device provides an operating system independent 
extension which allows seamless integration of the personal information 

30 services in accordance with the present invention. 
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In a particular unique aspect of the present invention, only those 
changes to the information which are required to be forwarded to other 
systems on the system of the present invention are transmitted to enable 
exceptionally fast response times. In a still further aspect of the invention, 
5 information which is transferred in this manner is encrypted to ensure 
security over the public portions of the Internet. 

Architecture Overview 

Figure 8 shows an overview of the architecture of the system of the 

10 present invention utilized for synchronizing or "syncing" information on 
different types of devices. In the embodiment hereinafter described, the 
system of the present invention allows the coupling of a collection of 
personal devices and applications one uses when working with personal 
information. Nevertheless, the system may be used to broadcast public or 

1 5 private information to various device types. System software in the form 
of a device engine for each device which is declared a part of the system 
of the invention is distributed across the collection of devices to enable 
synchronization. Distribution of the device engines may occur via, for 
example, an installation package forwarded over an Internet connection. 

20 In essence, the device engine software of the present invention forms a 
distributed processing network which maintains consummate 
synchronization of all information in the system. The processing load 
associated with delivering this service is pushed to the end-point devices 
which provides for easy scaling of the system to ever-larger applications. 

25 The present invention contemplates the use of two types of device 

engine: one totally embodied on the server which outputs change data to 
the server; and a second totally embodied on the server receiving device 
generated change information from the device. In addition, a hybrid of the 
two, having a portion of the device engine on the device and a portion on 

30 the server, is disclosed. 
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As shown in Figure 8, any number and type of devices 802-808 may 
be utilized in accordance with the system of the present invention. A 
telephone 802 may comprise a cellular phone or a standard POTS- 
connected telephone. Telephone 802 may include contact information 
5 and, as is supported with a newer generation of cellular telephones, 
appointments and task data stored in a data structure 812. The 
application 812 which utilizes the application data 822 comprising such 
information is all stored in the telephone unit 802. Likewise, a personal 
digital assistant such as a Palm® computing device 804 includes 

10 application 814 and application data 824 which may include information 
such as contacts, appointments and tasks, and may also include file 
information such as documents which are created and stored on the PDA 
804. Device 806 is represented as a Windows personal computer running 
an operating system such as Microsoft Windows 95, 98, NT or 2000. 

15 Applications 816 which may be running on device 806 include the 
Windows operating system itself, Microsoft Outlook, Symantec's ACT 
Personal Information Manager, Goldmine Software's Goldmine, Lotus 
Organizer, Microsoft's Internet Explorer web browser, Netscape's 
Communicator Suite, Qualcomm's Eudora e-mail, and various other 

20 programs, each of which has its own set of application data 826 which is 
required to be synchronized not only with devices outside the system 806, 
but also between devices and applications within the system itself. Finally, 
a dedicated web browser client 808 is shown which couples via the 
Internet to web portal applications 816 which have their own set of 

25 application data 828. Unlike devices 806 which store the application and 
application data substantially in their own hardware, web portal 
applications are provided on a separate server and provided to browser 
808 via an Internet connection. Nevertheless, the web portal application 
stored on the portal application provider includes a set of application data 

30 828 which a user may wish to synchronize. For example, a large web 
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portal such as Yahoo! and Snap.com provide services such as free e-mail 
and contact storage to their users. A user may wish to synchronize this 
with applications running on their cellular phone, PDA, or Windows 
devices. 

5 In order to access the specific application data of each of the 

systems shown in Figure 8, a device engine is associated with each type 
of device. A cellular device engine 862 communicates and incorporates 
itself with the application data 822 of the cellular phone. Likewise, a PDA 
device engine 864 is provided, which may be based on either the Palm® 

10 operating system, Windows CE operating system, or other PDA-type 
operating systems as necessary. A Windows-based device engine 866 
includes a mechanism, discussed below, for extracting application data 
826 from supported Windows applications 81 6, and a web services device 
engine 868 incorporates to extract application data 828 from web portal 

15 applications 818. 

As shown in Figure 8, some device engines are provided entirely on 
the device (and are referred to herein as desktop device engines), while 
others include components a the back end server (which may comprise 
storage server 850 or a specialized server, as shown in Figure 9B.) This 

20 is illustrated generally by lines 832, 834,836, and 838 in Figure 8. Also, 
in Figure 8, elements above dashed line 855 are provided by an 
administrator or service provider of the system of the present invention. 
Each of the device engines 862, 864, 866 and 868 is configured relative 
to the type of device on which it resides. For example, the Cell phone 

25 device engine 862 includes one or more components arranged on the 
phone while others are on server 850. Conversely, device engine 866 
resides entirely on the windows device 806. 

Data from each of the devices is coupled via an Internet connection 
710 with a storage server 850. As noted above, storage server 850 may 

30 be a generic storage server or it may be a storage server specifically 
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adapted for use with the system of the present invention as discussed 
below. One or more of the storage servers 850 are used to communicate 
transactions amongst the collection of systems 802, 804, 806, 808. It 
should be readily recognized that any number of different types of systems 
802, 804, 806, 808 may be provided in accordance with the present 
invention and incorporated into the system. However, for brevity, not all 
the different types of commercially available computing devices which are 
currently in use or in development, in which the system of the present 
invention may be incorporated, are listed. 

In its simplest embodiment, the storage server 850 is simply a dumb 
storage server and each of the device engines transmits only difference 
information thereto to be stored in a particular location accessible by other 
device engines in the system. In one embodiment, each device engine 
implements all processing required to keep all the systems fully 
synchronized. Only one device engine needs to be coupled to the storage 
server 850 at one particular point in time. This permits synchronization of 
multiple systems in a disconnected fashion. Each device engine will 
download all transactions encapsulating changes that have occurred since 
the last synchronization from the server and apply them to the particular 
device. 

The change or difference information (A) is provided in one or more 
data packages, the structure of which is described herein. Each data 
package describes changes to any and all transfer information across all 
device engines, including but not limited to application data, files, folders, 
application settings, and the like. Each device engine can control the 
download of data packages that include classes of information that apply 
to the specified local device 802, 804, 806 or 808 attached to that specific 
device engine. For example, device engine 862 will only need to work with 
changes to information describing contact names and phone numbers in 
application data 822, while device engine 866 will be required to work with 
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changes to e-mail, changes to document files, notes, as well as contact 
and address information since the application data 826 is much more 
extensive than application data 822. 

Each device engine includes compression/decompression and 
encryption/decryption components which allow encryption and/or 
compression of the data packages transmitted across Internet connection 
710. It should be recognized that compression and encryption of the data 
packages may be optionally provided. It is not required in accordance with 
the present invention. Each device engine performs mapping and 
translation steps necessary for applying the data packages to the local 
format required for that type of information in the application data stores 
822-828. The device engine also includes components which allow it to 
track ambiguous updates in cases where users have changed data to a 
particular data field on two different systems simultaneously since the last 
update. In this case, the device engine includes a mechanism for drawing 
this to the attention of the user and allowing the user to resolve the 
conflict. 

Device Engine Architecture 

Figure 9A illustrates a single device engine utilized with a generic 
application 81 0 and a generic storage server 850. Figure 9A illustrates 
a desktop device engine, since all processing occurs on the device and 
only difference information is transmitted to server 850. Nevertheless, an 
understanding of the desktop device engine will aid in understanding 
server side devices engines, hereinafter described. Shown in Figure 9 are 
the functional components of a device engine in block form and their 
interrelationship to each other. The device engine 860 is equivalent to the 
functional block of a differencing sequencer 104 shown in Figures 1-7. 

While the invention will be described with respect to the 
embodiment of the invention as a differencing synchronizer 1 04, it will be 
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readily understood that portions of the functionality are utilized as needed 
in a forward-only (a differencing transmitter) or a receive-only (a 
differencing receiver) capacity as required by the particular application. 

As noted above, a device engine exists for each and every device 
that makes up a user's personal information network of devices in the 
system. As shown in Figure 9A, each device engine 860 includes an 
application object 910. The application object is specific to each particular 
application 810 and provides a standard interface between the device 
engine and the balance of the data transmission system of the invention, 
and the application 810. Details of the application object will be described 
in further detail below. The application object is a pluggable architecture 
which supports a wide variety of vendor-unique applications. The job of 
the application object is to map data from the application into a temporary 
or "universal" data structure by connecting to the application via any 
number of standard interfaces to gain access to the applications data. The 
data structure of the application object puts the data in a generic or 
"universal data" format which may be used by the device engine 
components to generate data packages for provision to the storage server. 

Also provided is an application object store (AOS) 920 which 
includes a copy of the device's data at a point just after the previous data 
extraction and synchronization occurred. Application object store 920 is 
a mirrored interface which stores a snapshot of the previous state of the 
data from the application object 910 in the device engine. The size of the 
AOS will depend on the data being collected by each device engine. 

The generic output of the application object is provided to a delta 
module 950. Delta module 950 is a differencing engine which calculates 
differences in data between the output of the application object 910 and 
the copy of the data which is provided in an application object store (AOS) 
920. The actual differencing and patch routine can comprise a routine 
such as XDelta or YDelta. The delta module 950 will be referred to herein 
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alternatively in certain portions of the description as "CStructuredDelta." 
In addition, the difference information is alternatively referred to herein as 
a "change log." Each change log (or set of difference information) is a self 
describing series of sync transactions. As described below, the change 
log may be encrypted and compressed before output to the network. 

Hence, during a sync, the Application Object will, using a 
mechanism discussed below, extract the data of each application in the 
device and convert it to a universal data format. The delta module will 
then generate a difference set by comparing the output of the Application 
Object and the AOS. This difference information is forwarded to the 
encryption and compression routines for output to the storage server 850 
in the form of a data package. Alternatively, the data from one application 
can be used to synchronize to data in another application in, for example, 
a windows environment, as shown by arrow 1 050 in Figure 1 0. 

It should be specifically noted that the application object may 
interface directly unstructured binary data or with structured application 
data. The differencing routine supports both uses of the delta module 950 
in comparison generation. 

In some cases, operation of the application object and delta module 
is simplified by the fact that some applications, such as PDA's, have the 
ability to output changes to its data. In such cases, the delta module 950 
need only provide the data into the data package, since comparison to an 
AOS is not required - the application already includes a mechanism for 
tracking changes made to its own data. However, in many cases the 
applications provide, at most, a standard interface to access the data, such 
as Microsoft's OBDC interface, the Microsoft standard Application 
Programming Interface (API), or other similar standard interfaces. 

Device engine 860 further includes a versioning module which 
applies a version number per object in the data package. As explained 
further below, each object in the data package is assigned a universally 
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unique ID (UUID). Hence, unlike many prior synchronization systems, the 
system of the present invention does not sync data solely by comparing 
time stamps of two sets of data. Versioning module 915 allows each 
device engine to check the state of the last synchronization against data 
packs which have been provided to the storage server to determine which 
data packages to apply. This allows the device engine to sync itself 
independently of the number of times another device engine uploads 
changes to the storage server. In other words, a first device engine does 
not care how many times a second device engine uploads data packages 
to the server. 

An events module 925 controls synchronization initialization events. 
Items such as when to sync, how to sync, trigger the delta module 950 to 
perform a synchronization operation. 

A user interface 930 is provided to allow additional functional 
features to a system user of the particular device to which the device 
engine 860 is coupled. The user interface is coupled to a conflict 
resolution module 940, a filtering module 945, and a field mapping module 
935. Each of the modules provides the functionality both necessary for all 
synchronization programs, and which users have come to expect. 

Filtering module 945 allows filtering for types of content based on, 
for example, a field level content search. The field mapping module 935 
allows for the user to re-map certain interpretations of items which were 
provided in the document stream. For example, if the device engine 860 
is operating on a personal computer, and a synchronization is occurring 
between the personal computer and a notebook computer, and the user 
has a "my documents" directory on the personal computer which he wishes 
to map to a different directory on the notebook computer, the field mapping 
module 935 allows for this re-mapping to occur. It should be recognized 
that the field mapping module allows for changes in directing the output of 
the data package. The field mapping module 935 is not necessary to map 
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particular data fields of, for example, contact information from one 
application, such as Microsoft Outlook, to a different application, such as 
Symantec's ACT, as is the traditional use of field mapping and 
synchronizing applications. 

Delta module 950 is further coupled to a compression module 970 
and an encryption module 960. It should be recognized that the 
compression encryption modules need not be enabled. Any type of 
compression module 970, such as the popular PKZip or Winzip modules, 
or those available from HiFn Corporation may be utilized in accordance 
with the invention. Moreover, any type of encryption algorithms, such as 
MD5, RCH 6, Two Fish, or Blowfish, or any other symmetric encryption 
algorithm, may be utilized. In one embodiment of the invention, encryption 
without compression is used. In a second embodiment of the invention, 
compression without encryption is used. In a third embodiment of the 
invention, neither compression or encryption is used, and in a fourth 
embodiment of the invention, both compression and encryption are used. 

Versioning module 915 also allows the device engine 860 to support 
multiple users with distinct synchronization profiles. This allows multiple 
users accessing the same machine to each synchronize their own data set 
using the same device engine. For example, if the application 810 on a 
particular device comprises Microsoft Outlook on a personal computer, 
coupled to a Microsoft Exchange server, and Outlook is configured to have 
multiple user profiles, versioning module 915 will track the data applied 
through the device engine when a sync request occurs. This allows two 
users of the same Outlook client software which access different data sets, 
either in the client computer or on a separate server, to utilize the same 
device engine and the system of the present invention via the same 
machine. In a further embodiment, a particular device engine supports the 
use of foreign devices accessing the system via the same connection. 
Palm® devices, for example, use a cradle to connect to a computer and/or 
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Internet connection. If a particular user wishes to allow another user to 
use his Palm® pilot cradle connection to synchronize the other user's 
Palm® pilot, the device engine can generate data packages to update the 
local application object store for the foreign device. The application object 
store can therefore be used as a temporary storage for cases allowing 
synchronization of foreign devices. 

The output of the device engine 900 comprises a data package 
which is output to storage server 850. As noted above, only one device 
engine need be connected to the storage server 850 at a given time. The 
data package can be stored on the storage server 850 until a request is 
made to a particular location of the storage server by another device 
engine. Likewise, delta engine 900 can query alternative locations on the 
storage server for access to synchronized data within the system of the 
present invention. Access to areas of the storage server is controlled by 
a management server (MS) described more fully below. In one 
embodiment, each sync operation requires that the device engine for each 
device login to the management server to authenticate the device and 
provide the device engine with the location of the individual device's data 
packages on the storage server. 

Data packages may be advantageously provided to the device 
engine from the storage server in a streaming format, allowing processing 
to occur using a minimum of bandwidth and storage in the devices. The 
device engine 860 and particularly the delta module 950 interpret data 
packages based on the versioning information and the mirrored data 
present in the application object store 920. When data is returned to the 
delta module 950 from the storage server 850, the delta module returns 
differenced data to the application object 910 for the particular application 
which then translates the delta information into the particular interface 
utilized for application 81 0. Once a device engine has been fully applied 
all data packages from an input stream, it generates a series of data 
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packages that describe the changes made on the local system. The 
device engine uses the local application object store 920 to keep track of 
the last synchronized version of each application's actual data, which is 
then used for the next data comparison by the delta module on the next 
5 sync request. Generated data packages can include operations and 
encode changes generated from resolving ambiguous cases as described 
above. 

Figure 9B depicts how server based device engines may be 
provided in the system of the present invention. The Palm® device 

10 example is shown in this embodiment, where the Palm® device has the 
capability of connecting directly to the Internet and a service provider's 
data center 900. The data center includes a firewall 975 to prevent 
unauthorized communications with servers resident in the data center 900 
and protect integrity of the data. The storage server 850 may 

1 5 communicate directly through the firewall as may the management server 
(MS) 1410. 

Shown therein are two sync servers 982 and 984 each of which is 
dedicated to syncing one particular type of application. Sync server 982 
is dedicated to the Palm® device, while sync server 980 is dedicated to, 
20 for example, a portal application (Portah). 

Since the Palm® Device 804a includes a mechanism for 
transmitting changes to its data directly, data may be transmitted using 
HTTP request and response via the firewall 975 to the sync server 982 
where differencing and updating of data in the AOS can occur, after which 
25 changes can be downloaded to the Palm® 804a. 

The synchronization server is an application handles concurrent 
synchronization of user's data. Each Sync Server includes plug-in support 
for multiple devices to be synchronized using the same sync server 
executable. Each device type has it's own device name that identifies 
30 which AO / AOS components will be used during the sync. 
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The sync server uses the concept of a universal data record in its 
internal sync differencing engine and when sending data to and retrieving 
from external entities such as the AOS and AO. Hence, in the Palm® 
application, the job of a server AO is simply to take the device-specific 
format of its record and convert into a universal record format. 

The Sync Server has a plug-in architecture so that 3rd party 
application partners can easily add their services into the server. 
Currently, if the server is operated in a Microsoft Windows NT Server, the 
sync server discovers the sync components via the Windows NT registry. 
In alternative embodiments, this function is performed in a Component 
Manger which operates on each sync server to manage processing by 
each of the AO and AOS on the server. Each AO and AOS are 
implemented as a stand-alone DLL that the Sync Server loads at 
initialization time, or when adding a new component via the Component 
Manager. 

Each sync server is shown as dedicated to a single application. 
However, a sync server may handle multiple device types. 

In the embodiment of Figure 9B, it should be noted that, depending 
on the device type, there are different configurations for the AOS and 
AO's. For example, the Palm®'s AO data store 1 050 resides on the Palm® 
device 804a itself and a separate AOS data store 1052 exists for this 
configuration (an Oracle database). In the case of PortaM, the AOS and 
AO use the data store 1 054. 

Device engines can generate additional data packages intended to 
resolve synchronization problems in other systems. For example, 
interfacing with the conflict resolution module 940, if the user makes a 
change to a particular data store on an application object on his Palm® 
pilot, then makes an additional change to a personal information manager 
(PIM) application on his personal computer, the user can specify that the 
change made on the personal computer will "win" when the conflict is 
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detected by the A engine and the versioning information between the two 
devices. This is essentially a definition that one particular set of data is 
correct and should replace the second set of data. 

Figure 1 0 shows a specific embodiment of a desktop device engine 
5 utilized in, for example, a Microsoft Windows-based operating system 
environment. 

As shown in Figure 10, a Windows operating system may have at 
least three specific applications which may require synchronization. In 
Figure 10, the system includes Netscape Communicator application 1040 

1 0 having data such as bookmarks 1 021 , contacts 1 022, and e-mail 1 023; a 
Microsoft Outlook application 1042 which includes contact information 
1024, calendar information 1025, e-mail information 1026, note information 
1027, and tasks information 1028; and Windows operating system 1044 
information including Favorites data 1029, file system information 1030, 

1 5 and individual files 1 031 . 

Each particular application 1040, 1042, 1044 has an associated 
application object 1010, 1012, 1014. Each of the respective application 
objects provides data back to delta module 950 in a generic format which 
is usable by the delta module in accordance with the foregoing description 

20 of the apparatus shown in Figure 9A. From Figure 10, it will be 
additionally seen how the delta module 950 may be utilized to synchronize 
data between applications running on the same particular server. The 
device engine hence does an intra-system sync such as, for example, 
between the contact information 1022 from Netscape and the contact 

25 information 1 024 from Outlook. 

Figure 10 further illustrates the modularity of the system of the 
present invention allowing the device engine to include any number of 
different application objects to be provided on a single device to 
incorporate all applications run on that device. 

30 In operation, during an installation of a device engine into a 
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particular system, the installation program may be tailored to provide 
application objects which may be present on a given system. For example, 
and with reference to Figure 10, the installation program for a Windows 
machine will carry any number of application objects for systems and 
5 applications which may be present on a Windows machine. The installer 
will check for the presence of given applications, and allow the user to add 
additional applications which may be installed in locations that are not the 
normal default installation areas for application support by the application 
objects which the installer is carrying, or de-select certain applications 
10 which, for one reason or another, the user may not wish to install an 
application object for and render a part of the system of the present 
invention. 

Application Object Structure 

1 5 Figure 1 1 is a conceptual depiction of the structure of an application 

object. As noted above, the application object is a pluggable architecture 
which supports a wide variety of vendor-unique applications. The 
consistent and scalable architecture of the system of the present invention 
for device engines is maintained by encapsulating system-dependent 

20 knowledge in a single component, i.e. the application object. As noted 
above, every application object supports a standard set of interfaces that 
every device engine understands. Each application object maps these 
standard interfaces of the capabilities of a particular vendor application. 
Hence, there will be as many application objects as there are application 

25 types. 

As noted above, there are different types of server and desktop 
device engines, some having application objects entirely on the server, 
while others have application objects entirely on the desktop. 

Each application object will include a connector 1110 which may 
30 comprise a generic interface to the particular application for which the 
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application object store has been designed. For example, when 
connecting to a Palm® device, the connector will be an HTTP protocol 
request routine which interfaces with the Palm® device's own built-in 
synchronization manager, which provides an output of records which have 
5 been changed on the Palm® device. As in Figure 9B, since the Palm® 
outputs all the changes to its data via its own sync manager, in the Palm® 
application, the job of a server AO is simply to take the device-specific 
format of its record and convert into a universal record format. 

The connector provides access for the application object to remove 

10 the data field from a particular application and convert it to a universal 
record structure. In the desktop AO, where, for example the application 
object is designed for a Windows interface, the connector may be the 
Windows API and the job of the AO will be to translate data from, for 
example, the windows file system to a universal data format. This universal 

1 5 data structure is then used by the delta module 950 to build data packages 
to be used in synchronization between components of the systems 
provided in the network system of the present invention. 

Universal data structure mapping, used on desktop application 
objects, and universal data record mapping, used by the server device 

20 engines, is further detailed below. 

Desktop Application Object 

Each Application Object (AO) is a software component that 
interfaces with the third party application APIs (Application Programming 
25 Interface) to provide the programming services to the delta module for 
extraction and deposition of information data from and to the third party 
application domain during synchronization. In addition, the AO maps the 
third party application data fields to system's domain. 

The AO service is a collection of COM (Component Object Model) 
30 objects that can be developed in conjunction with the third party Windows 
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application APIs as a form of a DLL (Dynamic Linked Library) in C or C++. 
The DLL is loaded on demand at runtime during synchronization. It should 
be recognized that the application object need not be implemented using 
the COM model, but may be developed with other distributed object 
5 models. 

There are a number of the related subsystems and documents that 
the developer must be familiar with and this document has made many 
references to those subsystems during the course of presenting the AO. 
Change Log (CL) (or differencing information) , a data file which 
1 0 contains a series of synchronization transactions. 

• DataPack, a compacted and encrypted Change Log. 
StructuredDelta, the delta module differentiation engine that 
generates differences between Application Objects and Change 
Log and AOS. 

1 5 • AOS, a database which resides locally on, for example, a windows 
machine. 

• MS, a management server that manages users' accounts. 
SS, an FTP or storage server that manages data packs. 

• User Manager, a standalone Windows client Ul program that 
20 manages the synchronization process. 

• ePortal, a web-based PIM portal site. 

pio_types.h, a header file which contains the definitions of the 
system's supported data fields known as tags. 

• Def.h, a header file contains the definitions of the system's 
25 constants. 

interfaces.!!, a COM interface file contains AO interface definitions. 
Each AO has a COM interface-based design built-in. That is, 
instead of providing a set of traditional APIs as programming services, it 
provides a set of interface-based objects as programming services. 
30 StructuredDelta, the delta module, the primary intended user of 
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each AO. StructuredDelta instantiates these COM objects and uses them 
throughout the synchronization session exclusively through the COM 
interfaces on those objects to interface with the third party application 
database. 

5 Each AO component consists of a set of objects that translate the 

third party application data into the universal data middle format which 
underpins the entire spectrum of PIM data regardless of which third-party 
application the data comes from. The objects in universal data format are 
device, (application) data class, store, folder, item, and data fields. 

1 0 The AO digests the third party application data of any kind and reduces it 
into a few handful simple objects and field types. These objects and field 
types are fed into StructuredDelta engine and are compared by 
StructuredDelta in order of their hierarchy. The resulting differences (add, 
delete, modify) are logged as transactions in the difference information. 

1 5 The data packs are transported to a storage server that may be actively 
managed by a management server for each individual user account and 
devices. 

StructuredDelta uses AO objects to access and modify the 
individual AO objects and data fields. AO objects serve as a buffer 

20 between individual application data and StructuredDelta so that 
StructuredDelta does not require knowledge of each application and 
database. All AO objects are temporary and created in the space of each 
AO by StructuredDelta through COM interfaces. AO objects are 
referenced when they are in use and they are freed when StructuredDelta 

25 stops using them. One can think of AO objects as merely placeholders of 
each application objects for StructuredDelta to access. Once 
StructuredDelta has a particular Application's data, StructuredDelta would 
free AO objects immediately without storing them internally. 

30 
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AppQbi 

AppObj is a root object of each AO component and there is one and 
only one per AO. AppObj provides an entry point into the individual 
application's database. StructuredDelta instantiates it and holds it on 
5 during the entire synchronization session and releases it afterward. 
AppObj offers a number of services such as what class of data it supports. 
The C++ example of AppObj's definition is shown below: 

class CMyFlAppObj : 

public Item, 
1 0 public AppObj , 

protected Module Identity, 

protected DataClassInf o, 

protected ItemTypelnf o, 

protected ItemFieldMap, 
15 protected Folderlnfo, 

protected DataFilelnf o, 

protected SynchNotify, 

protected ErrorMsg, 

protected EnumI terns, 
20 protected Findltem, 

protected Modifyltem 

{ 

public: 

25 CMyAppObj ( HWND hWndParent ) ; 

-CMyFppObj { ) ; 



30 AppObj can contain children objects. They are Store objects. 

Enumltems interface is used to enumerate Store objects. Findltem 
interface is used to find the contained objects. Modifyltem interface 
enables AppObj to create a new Store object. AppObj is created by 
StructuredDelta calling CreateAppObject( HWND hWndParent, AppObj 

35 **ppObj). 



Store 

The Store object represents a database of the individual application 
information. If the individual application can handle multiple databases at 
40 same time, one needs multiple Store objects. One can think of Store object 
as a specialized Folder object, the root folder of each particular application 
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data domain. The C++ example of Store's definition is shown below: 

class CMyStore : 

public Item, 
public item.Contad.ner, 
5 protected EnumI terns, 

protected Findltem, 
protected FindltemByData, 
protected Modifyltem, 
protected ReadWrite 

10 { 

CMyStore ( ) ; 
-CMyStore () ; 



1 5 store is a container of Folder objects. Enumltems interface enables 

the enumeration of its contained folders while Findltem and 
FindltemByData interface is used to find contained Folders or Item 
objects. Modifyltem and ReadWrite interface enables the modification 

20 of each application database. 

Folder 

Folder object is a specific data class of each individual application 
such as a table in the relational database or a collection of data records in 
25 each application. For example, the applications contact collection can be 
thought as a Folder object. The C++ example of Folder's definition is 
shown below: 

class CMyFolder : 

public Item, 
30 public itemContainer, 

protected Enumltems, 
protected Findltem, 
protected FindltemByData, 
protected Modifyltem, 
35 protected ReadWrite 

{ 

public: 

CMyFolder ( ) ; 
-CMyFolder ( ) ; 

40 }; 

Folder object is also container. It can contain Item objects as well 
as Folder objects. Enumltem interface allows the enumeration of either 
Folder objects or Item objects or both. Findltem and FindltemByData 
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interface is used to find contained Folder objects or Item objects. 
Modifyltem and ReadWrite interface enables the modification of an 
application's data tables. 



Item 

Item object represents an individual entity of each application's 
domain specific data. Item object can be thought as a record of each 
application's relational table. For example, a contact, email, calendar, to- 
do item in the particular application can be thought of as an Item object. 
The C++ example of Item's definition is shown below: 

class CMyltem : 

public Item, 
protected Enuml terns, 
protected Findltem, 
protected Modifyltem, 
protected ReadWrite 

{ 

public: 

CMyltem () ; 
-CMyltem () ; 



Item can contain Attachment objects only. Enumltems interface 
enables the enumeration of Attachment objects if any. Modifyltem and 
ReadWrite interface enables the modification of an application's records 
or data fields. 



Attachment 

Attachment object is a specialized Item object that encapsulates an 
attachment data or relationship. Only Item can have Attachment objects. 
Attachment object can be thought as attachment data such as attached- 
email files. Attachment can also be thought as attachment relationship to 
other Item objects. The example of that is the distribution list (Item object) 
can contain contacts (Item objects). The C++ example of Item's definition 
is shown below: 

class CMyltemAttachment : 
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40 



public Item, 
protected ReadWrite, 
protected Modifyltem 



CMyltemAttachment ( ) ; 
~CMyItemAttachment ( ) ; 



10 

Variant 

Variant object represents a data field of each particular application 
data. For example, a 'first name' of a contact or the birthday date of a 
contact can be thought as Variant object. StructuredDelta only 
15 understands Variant object and the types of data fields it encapsulated. 
Variant object can contain any one of the following data field type: 

struct Variant 
{ 

enumFieldTag tag; 
20 enumFieldDataFlag flag; // flags item fields as not 

known or otherwise special 
union 
{ 

short int i; // eFieldType_WORD 

25 LONG 1; // eFieldType_LONG 

DWORD dw; // eFieldType_DWORD 

unsigned int64 qw; // eFieldType_QWORD 

UUID uuid; // eFieldType_UUID 

DATE time; // eFieldType_DATE 

OO LPTSTR psz; // 

eFieldType_String 

Binary bin; // eFieldType_Binary 

Float fit; // eFieldType_Float 

Double dbl; // 
35 eFieldType_Double 

FICollection coll; // 
eFieldType_Collection 
} Value; 

Stream* strm; // eFieldType Stream 

}; 



Variant::tag is an identification tag of data field and variant: :flag 
specifies the type of data field while Variant:: value member variable 
stores each application's field value. One data field type is Collection. 
45 Collection object is an array of Variant objects. It can be used to 
represent a compound data fields. 



struct Collectio 



50 



cValues ; 

paVar; // This array really 
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5 Another data field type that is worth exploring is Binary. Binary 

object can be used to represent a binary data as it is. 

struct Binary 

{ 

ULONG cb ; 

10 LPBYTE lpb; 

}; 



15 AO Interfaces 

Each AO object has an AO COM interface. Each object must 
implement some of those interfaces to create certain capability or desired 
behavior that are expected by StructuredDelta. 

20 litem 

This is the base interface of all application objects. It provides the 
identification service to StructuredDelta. Every object must have a unique 
ID, parent unique ID, display name, and item type information 
(eltemType_FOLDER, eltemType_CONTACT, etc). The unique ID is a 

25 unique string only in a given device. It is not persistent cross the Internet 
to other devices. The ID usually comes from the third party application 
database domain such a unique ID of a record. 

interface litem :: IUnknown 

30 STDMETHOD_ ( LPCTSTR, GetUniquelD) () const PURE ; 

STDMETHOD_ (LPCTSTR, GetParentUniquelD) () const PURE; 

STDMETHOD_ { LPCTSTR, GetDisplayName ) () const PURE; 

STDMETHOD_(enumItemType, GetltemType) () const PURE; 

STDMETHOD_ ( BOOL, IsContainer) () const PURE; 
35 STDMETHOD_ ( DATE , GetLastModif icationTime ) () const PURE; 

STDMETHOD_ ( QWORD , GetSize) () const PURE; 

STDMETHOD_ (DWORD, GetFlags) () const PURE; 

}; 

40 lltemContainer 

This is the base interface of all application container objects (store, 
folder). These container objects must have this interface implemented so 
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that StructuredDelta would recursively descend in them if they have 
lltemContainer capability. 

interface lltemContainer : litem 
{ 

STDMETHOD_<BOOL, ContainsItemType) ( enumltemType eltemType ) PURE; 
STDMETHOD_ (BOOL, ContainsDataClass ) ( enumDataClas s eDataClass ) 

PURE ; 

STDMETHOD_(enumSpecialFolderType, GetSpecialFolderType) () PURE; 
STDMETHOD_ (GUID, GetMappingGUID) {) PURE; 



10 }; 

lErrorMsg 

This is an error-reporting interface for every application object. It 
1 5 is used by StructuredDelta to query the error string after a failure. The AO 
should implement this on every object after the error occurs and before 
returning the control to StructuredDelta. 

interface IErrorMsg : IUnknown 

20 STDMETHOD(GetErrorString) ( LPTSTR pszError, int iBufLen 

) const PURE; 



25 lEnumltems 

This is an interface for collection enumeration, used by 
StructuredDelta to enumerate the objects of the third party application 
database. lEItemEnumFlags (eltemEnumFlags_FOLDER, 
eltemEnumFlagsJTEM, andeltemEnumFlags_ATTACHMENT) is used to 

30 enumerate only the requested type of objects. 

interface lEnumltems : IUnknown 

{ 

STDMETHOD (ItemQueryStart) ( enumltemType type, long 
&lCount, eltemEnumFlags dwFlags ) PURE; 
35 STDMETHOD (ItemQueryNext) ( Item **ppltem ) PURE; 

STDMETHOD (ItemQueryFinish) () PURE; 

}; 

40 IFindltem 

This is an interface for recursively finding object within the third 
party application database, used by StructuredDelta to find application 
object by its unique ID. 
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interface IFindltem : IUnknown 

{ 

STDMETHOD (FindStoreBylD) ( LPCTSTR pszUniquelD, ItemContainer 
**ppFolder ) PURE; 

5 STDMETHOD (FindFolderBylD) ( LPCTSTR pszUniquelD, ItemContainer 

**ppFolder ) PURE; 
STDMETHOD (FindltemBylD) ( LPCTSTR pszUniquelD, Item **ppltem ) 
PURE ; 

}; 

10 

IFindltemBvData 
This is an interface for recursively finding the object that matches 
the search criteria data. The search criteria are represented as Collection 
15 that allows the multiple search field keys to be used during the search. 
The multiple objects may be found that match the search criteria. The 
interface also provides enumeration capability of the search results. 

interface IFindltemByData : IUnknown 

20 STDMETHOD (FindByDataStart) ( enumltemType type, Variant* 

pSearchKey, int* pnFound ) PURE; 
STDMETHOD (FindByDataNext) ( LPTSTR pszEntrylD, int 
cbBufSize ) PURE; 

STDMETHOD (FindByDataFinish) () PURE; 

25 }; 



IModifvltem 

This is an interface for StructuredDelta to add, delete, and re-parent 
30 application data in the third party database during synchronization. 

interface IModifyltem : IUnknown 
{ 

STDMETHOD (Add) ( BOOL bFolder, enumltemType type, Item 
**ppltem ) PURE; 
35 STDMETHOD (Delete) () PURE; 

STDMETHOD (Move) ( ItemContainer * pDestFolder ) PURE; 

}; 



40 I Read Write 

This is an interface for accessing, writing, and mapping the third 
party application data fields by StructuredDelta. It provides the capability 
of read and write data fields from and to the third party application 
database and the capability of mapping data field of the third party 

45 application to universal data format of the system of the present invention. 
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Any object that has data fields and require field level synchronization must 
implement this interface. 

interface IReadWrite : IUnknown 

5 ^ STDMETHOD (Read) () PURE; 

STDMETHOD (Commit) () PURE; 

STDMETHOD (GetFieldData) ( enumFieldTag fieldTag, Variant 
**ppVariant ) PURE; 

STDMETHOD (ReleaseFieldData) ( Variant *pVariant ) PURE; 
10 STDMETHOD (SetFieldData) ( const Variant *pVariant ) 

PURE ; 

}; 



15 

lAppQbi 

This is an AppObj only interface. It provides the capability of logon 
and logoff to the third party applications during synchronization. The data 
class filter mechanism is used by StructuredDelta to filter the enumeration 
20 of contained data classes (eDataClass_CO NTACT, 
eDataClass_CALENDAR, etc). 

interface IAppObj : IUnknown 
{ 

STDMETHOD (Logon) ( HWND hWndParent ) PURE; 
25 STDMETHOD (Logoff) () PURE; 

STDMETHOD (SetFilter) ( const VOID* pFilter, int BufLen ) 
PURE ; 

STDMETHOD_(int, GetFilter) ( VOID* pFilter, int BufLen ) 
PURE; 

30 }; 



IModuleldentitv 

This is an AppObj only interface. It provides DLL module 
35 identification information to the Manager object such as the name of the 
third party application, enum ID of this application, and the application 
installation detection support. 

interface IModuleldentity : IUnknown 

40 STDMETHOD (GetName) ( LPTSTR pszName, int iBufLen ) const 

PURE; 

STDMETHOD (GetAppl) ( Appl *pAppl ) const PURE; 
STDMETHOD (I slnstalled) ( BOOL *bl slnstalled ) const 
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HtemTvpelnfo 

This is an AppObj only interface. It provides the information on the 
number of item types supported by AO, what type items are supported and 
the capabilities for a specific item type. This returns a DWORD containing 
bits set. 

interface I ItemTypelnf o : IUnknown 

STDMETHOD (Get Support edTypes Count) ( int SiCount } PURE; 

STDMETHOD (GetSupportedTypelnf o) ( int ilndex, 
enumltemType &type, LPTSTR pszTypeName , int iBufLen ) PURE; 

STDMETHOD (GetltemTypeCaps) ( enumltemType type, DWORD 
sdwFlags ) PURE; 
}; 



IDataClasslnfo 

This is a CAppObj only interface. It provides the information on the 
number of data classes that are supported by the application object and 
20 what the data classes are supported 

interface IDataClasslnfo : IUnknown 
{ 

STDMETHOD (GetCount) { int *piCount ) PURE; 
STDMETHOD (GetDataClas s ) ( int ilndex, enumDataClas s 
25 *peDataClass ) PURE; 

}; 

IDataFilelnfo 

30 This is a CAppObj only interface, it provides information on the 

number of database files and database filenames supported by AO to 
avoid being synched twice by application sync and file-set sync. 

interface IDataFilelnfo : IUnknown 

35 { STDMETHOD (GetDataFileCount) ( int *piCount ) PURE; 

STDMETHOD (GetDataFilePath) ( int ilndex, LPTSTR 
pszFilePath, int iBufLen ) PURE; 



40 



UtemFieldMap 

This is a CAppObj only interface that is used by StructuredDelta to 
query the data fields of given application object. For example, what are 
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data fields in application object called eltemType_CONTACT? 

interface IltemFieldMap : IUnknown 

{ 

STDMETHOD (FieldQueryStart) ( const enumltemType Stype, 
int siCount ) PURE; 

STDMETHOD (FieldQueryNext) ( enumFieldTag Sfield, LPTSTR 
pszName, int iBufLen, LPTSTR pszType, int iTypeBufLen )PURE; 

STDMETHOD (FieldQueryFinish) () PURE; 

}; 



This is a CAppObj only interface, used by Structured Delta to obtain 
the special and default folders' unique IDs and UUIDs. 

interface IFolderlnfo : IUnknown 
{ 

STDMETHOD (GetSpecialFolderlD) ( enumSpecialFolderType 
eFolder, LPTSTR pszUniquelD, int iBufLen ) PURE; 

STDMETHOD (GetDef aultFolder ID) ( enumltemType type, 
LPTSTR pszUniquelD, int iBufLen ) PURE; 

STDMETHOD (MapFolderGUID) ( UUID uuidFolder, LPTSTR 
pszUniquelD, int iBufLen ) PURE; 

}; 



25 IFastSvnc 

This is a CAppObj only interface that is used by StructuredDeita to 
query if the given AO also provides FastSync service or not. FastSync is 
a DLL component that is written using the third party APIs and loaded into 
the third party application to receive the changes in database while users 

30 are operating the application, it is used to speed up the synchronization 
performance by syncing only the objects that are known to IFastSync 
component. 

interface IFastSync : IUnknown 
{ 

35 STDMETHOD (GetFastSync) ( enumDataClass eDataClass, BOOL* 

pbFastSync ) PURE; 



40 SvnchNotifv 

This is a CAppObj only interface that is called by Manager to notify 
the third party application the state of synchronization: start, finished, or 
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reset so that the application can prepare itself accordingly. 

interface ISynchNotify : IUnknown 

STDMETHOD (SynchNotif y) ( enumSynchNotif y eNotify ) PURE; 



Server AO 

Server Application Objects share many characteristics with desktop 
10 application objects, including support for reading and mapping to the 
universal record structure set forth above. 

Nevertheless, among various devices incorporated into the system 
of the present invention, each application object database will be quite 
different. For example, the Palm® database on the device is really just a 
15 memory space with records laid out sequentially in memory. In a web 
portal-type application, the application object may be an Oracle database. 
Server application objects may generally have less difficult tasks since the 
applications supported are generally either devices providing their own 
change data output, (such as Palm®-type PDA's), or which do not have a 
20 great deal of data to export (such as cell phones, having only name and 
number information). 

Nevertheless, each application object must support all calls defined 
in a class interface definition as follows: 



FUNCTION 


DESCRIPTION 


Open 


Perform an initialization of the device 
before data retrieval functions are called. 


Close 


Done with database calls, cleanup if 
necessary. 


Get First Modified Record 


Get the first modified record from the 
device and insert into application object. 


Get Next Modified Record 


Get the next modified record from the 
device and insert into the application 
object. 
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Add Record 


Add a record into the application object 
database. 


Update Record 


Update a record. 


Delete Record 


Delete a record in the application object 
database. 


Set Device Records 


A function called during the synchronization 
manager to send a bytestream to the 
application object for interpretation. The 
bytestream will contain a list of records to 
add to the application object modified 
records list. At a later point in time, such 
records will be retrieved by the Get First 
Modified Record/Get Next Modified Record 
functions. 


Get Device Records 


For records bound to the device, this call 
gets a bytestream that contains a list of 
records to add back to the device. There is 
an outbound record list that is saved until 
this call is finished, at which time the sync 
server will be finished with the application 
object. 


Set Device Response 


A function used to modify or repair a record 
input saved in the application object store 
that was sent to the device in the Get 
Device Records call, such as a record ID 
for a record. If 1 0 records were sent to the 
device during the Get Device Records call, 
one would expect to see 10 records coming 
back in during this function call. 



As noted above, because each application object database is 
different, the calling convention and the application object itself will 
10 likewise be different. The calling convention for a Palm® device's sync 
manager application object is given in the following pseudo-code: 



Start synchronization process 

While more records in AO Data Object 

Call AO: : GetFirstModif iedRecord ( ) 
20 Call AO: : GetNextModif iedRecord ( ) 

END 

IF new records THEN 

Call AO: :AddRecord() 
25 IF deleted records THEN 

Call AO: : DeleteRecord ( ) 
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IF update record THEN 

CALL AO : : UpdateRecord ( ) 



Call AO: : Close 



As shown therein, the calling convention is designed to be integrated with 
the Palm's® own sync manager. 

A second example provided below shows mapping of a portion of 
a web portal's contact database: 

Mappingltem CContactTable : :m_FieldMap [] = 

{ {1 eFieldTag Contact_Fir stName , " f irstname" } , 

1 e FieldTag~Contact_MiddleName, "middlename }, 

{1 e FieldTag_Contact_LastName, >r 

{1, eFieldTag_Contact_Title, "I^ffix") 

n eFieldTag Contact Suffix, suriix i, 

^ ^FieldTaglContactlAnniversary, ^thday-f 

{1, eFieldTag Contact_Birthday , .-^^Stname"} 

1 eFieldTag _ Contact_A S sist a ntName, assistantname }, 

1 eFieldTag Contact Children, "children }, 

I', eSldTaglcontactlCompanyName, I^SV ' 

1 e FieldTag_Contact_Department, department }, 

[1 eFieldTag_Contact_FTPSite ; ^ftpsite) , 

{1, eFieldTag_Contact_Gender, -Mohtitle"! 

n eFieldTag Contact JobTitle, jobtitie J, 

1 ' eFieldTaglContactlManagerName , "managername" } , 

{1, e FieldTag_Contact_NickName f ^ nickname ), 

{1, eFieldTag Contact Office, ° I \' , 

{ 1 eFieldTaglcontactJrofession, '-profession }, 

U eFieldTag Contactjpouse, spouse ), 

{1, e FieldTag~Contact_SelectedMailingAddress, 
"selectedmailingaddress"} 

int CContactTable: :m_nNumFields = 
sizeof (m_FieldMap) /sizeof (Mappingltem) ; 

HRESULT CPortalAddrOCI::InsertRecord( Mappingltem theMap[] , int 
nu^FiiLs! CDatiSccessor *plnsertltem, CFlItemUniversal *pUmvItem, 
bool bForceCreate ) 

{ bool bHasData = SetRecordFields ( theMap, numFields, 

plnsertltem, pUnivItem ) ; 

if( bHasData I I bForceCreate ) 

// insert the record into the database and execute the command 
pInsertItem->InsertRow(0) ; 
pInsertItem->Exec {) ; 

I 



The above example of mapping the contact field files maps contact 
fields from a particular web contact information database to fields in the 
universal record format from the master list header file (piojypes.h) in the 
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system of the present invention. This mapping is for a specific contact 
table and it should be understood that other information, such as phone 
numbers, e-mail addresses, and other contact information may be stored 
in a separate table. 

Once data is extracted from a particular application, the server 
application object must then convert the information into the universal 
record format which can be utilized by other server device engines to take 
content information into their own particular application. 

Universal Record Format 

The universal record format is used by each server device engine 
to handle various tasks of encapsulating records in a common format, 
comparing records, creating and holding differences between records, and 
other tasks of synchronization. 

The universal record format allows the application objects to support 
a wide range of extensible application item types such as contacts, 
calendar, mail, bookmarks, and the like. Flexible type name and value 
associations permit synchronization without regard to individual vendor 
application information formats. Each application object encapsulates 
mapped knowledge from the vendor unique format to the universal format 
of the present invention. As such, an application object can be designed 
to support any combination of application and binary information types. In 
essence, application objects can be designed to support a vendor 
application using only binary file synchronization if the internal format of 
the application is not known. 

Server application objects can also be designed to create 
collections. For example, if the user wishes to create a "my pictures" 
collection which consists of some collection of information and synchronize 
this collection of information, such an arbitrary grouping of classes of 
information into appropriate representations is supported. 
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Because the connector layer of the interfaces to the actual storage 
with a vendor application varies with application type, application access 
methods can include, but are not limited to, disk or database access, 
network protocols, wireless device protocols, and the like. 

The Universal Records Format and the Universal Field Format class 
definitions are given below: 

typedef map < enumFieldTag, CUniversalField, less_enumFieldTag > 
UniversalRecordMap; 

typedef UniversalRecordMap : :value_type UniversalRecordPair ; 
typedef UniversalRecordMap :: iterator UniversalRecordlterator ; 
typedef UniversalRecordMap: : const_iterator 
ConstUniversalRecordlterator; 

class CUniversalRecord 
{ 

private : 

UniversalRecordMap recordMap_; 
public: 

bool conflicts (const CUniversalRecordS rhs) ; 
bool add(const CUniversalRecord Srhs); 
bool subtract (const CUniversalRecordS rhs) ; 

CUniversalRecord ( ) ; 

CUniversalRecord ( const CUniversalRecordS rhs ) ; 
virtual -CUniversalRecord ( ) ; 

// add this element 

HRESULT insert ( enumFieldTag eld, long value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

HRESULT insert ( enumFieldTag eld, LPCTSTR value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal) ; 

HRESULT insert ( enumFieldTag eld, DATE value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

HRESULT insert ( enumFieldTag eld, string value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

HRESULT insert ( UniversalRecordPair p ) ; 

CUniversalRecord exclusiveLef twins ( CUniversalRecordS rhs ) ; 
CUniversalRecord inclusiveLef twins ( CUniversalRecordS rhs ) ; 
bool removeSame (const CUniversalRecord Srhs); 

bool Findf const enumFieldTag eld, CUniversalField afield ); 
UniversalRecordMap: : iterator f ind ( const enumFieldTag eld ) { 
return recordMap_. find (eld) ; } 

UniversalRecordMap: : iterator begin () { return 

recordMap_. begin ( ) ; } 

UniversalRecordMap: : iterator end ( ) { return 

recordMap_. end ( ) ; } 

bool empty () { return 

recordMap_. empty ( ) ; } 

long sized { return 

recordMap_. size ( ) ; } 

UniversalRecordMap: : iterator erase (UniversalRecordMap: : iterators 

it) 

{ return recordMap_. erase (it) ; } 
void clear () { recordMap_. clear () ; } 
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The UniversalField Structure 

5 class CUniversalField 

{ 

enum eUniversalField 

10 ^ eUF_Unknown, 

eUF_Long, 
eUF_String, 
eUF_Date, 
eUF Blob 

15 }; 

protected: 

eUniversalField typeld_; 

enumFieldTag fieldld_ 

20 enumFieldDataFlag flag_; 



25 long 1; 

DATE d; 
TCHAR* pCh; 
} value_; 

30 public: 

CUniversalField ( ) ; 

CUniversalField ( const CUniversalFieldS rhs ); 

CUniversalField ( enumFieldTag itemld, long value, 
enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 
35 CUniversalField ( enumFieldTag itemld, DATE value, 

enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

CUniversalField { enumFieldTag itemld, LPCTSTR value, 

enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

CUniversalField ( enumFieldTag itemld, string blob, 
40 enumFieldDataFlag flag = eFieldDataFlag_Normal ) ; 

~CUniversalField ( ) ; 

bool operator==( const CUniversalFieldS rhs ) const; 
bool operator !=( const CUniversalFieldS rhs ) const { ret 
45 !operator== (rhs) ; } 

CUniversalFieldS operator= ( const CUniversalFieldS rhs); 

eUniversalField getType() const { return typeld_; } 
enumFieldTag getFieldID() const { return fieldld_; } 
50 enumFieldDataFlag getFlagO const { return flag_; } 

size_t getLengthO const {return len_; } 

LPCTSTR getStringO const { ASSERT ( eUF_String == 

typeld_) ; return value_.pCh; } 

55 long getLongO const { ASSERT ( eUF_Long == 
typeld_) ; return value_.l; } 

DATE getDate ( ) const { ASSERT ( eUF_Date == 
typeld_) ; return value_.d; } 

string getBlob ( ) const { ASSERT ( eUF_Blob == 
60 typeld_) ; return string (value_. pCh, len_) ; } 

void get ( LPCTSTR& p ) const { ASSERT ( eUF_String == 

typeld_) ; p = value_.pCh; } 

void get ( longs 1) const { ASSERT ( eUF_Long == 

65 typeld_) ; 1 = value_.l; } 
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void get( DATES d) const { ASSERT ( eUF_Date == 

typeld_) ; d = value_.d; } 

void get( strings b) const { ASSERT ( eUF_Blob == 
typeld_) ; b. assign (value_.pCh, len_) ; } 

bool isStringO const { return typeld_ == 

eUF_String; } 

bool isLongO const { return typeld_ == eUF_Long; } 

bool isDate() const { return typeld_ == eUF_Date; } 

bool isBlob() const { return typeld_ == eUF_Blob; } 



Example 

An example of how data is removed from one particular application 
data type and converted into the universal record format is given below for 
an Oracle database: 



#include "stdafx.h" 

ttinclude <string> 
using namespace std; 
#include "FlltemUniversal .h" 

#include "oci.h" 
iinclude "OCIDefs.h" 
#include "OCIConnect . h" 
#include "OCISession. h" 
#include "OCIColumn.h" 
iinclude "OCICursor .h" 
#include "DataAccessor . h" 

#include "UniversalMapper . h" 
#include "UniversalRecord.h" 
#include "FlUtil.h" 

tinclude "BaseAOSTableOCI . h" 



/* 

* Function: MapFields 

* Description: Map fields from an Oracle database record into an 
UniversalRecord format. 

*/ 

void CBaseAOSTableOCI : :MapFields { CDataAccessor *pAccessor, Mappingltem 

theMap[], int numFields, CUniversalRecord SunivRec ) 

{ 

string s Value; 
DATE dtValue; 
LONG lvalue ; 

double dValue; 

for( int inx=0; inx<numFields; inx++ ) 
{ 

enumFieldTag fieldID = theMap [ inx] .m_universalFieldID; 
switch( FlPropType( fieldID ) ) 
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case eFieldType_Binary: 
{ 

// to fill properly, 1st name and last name should already be assigned 
CUniversalField emailField; 
string sValue; 

if ( SUCCEEDED (BuildEmailField { pAccessor, 

sValue, emailField }) ) 

univRec. insert ( fieldID, 

emailField. getBlob () ); 

break; 

} 

case eFieldType_String: 

if( pAccessor->GetFieldValue ( fieldID, sValue 

) ) 

{ 

if ( 0 == : :_tcslen( sValue. c_str() ) ) 
univRec. insert ( fieldID, sValue . c_str ( ) 



case eFieldType_DATE: 

if( pAccessor->GetFieldValue ( fieldID, dtValue 

univRec. insert ( fieldID, dtValue ) ; 

break; 

case eFieldType_DWORD: 

if( pAccessor->GetFieldValue ( fieldID, lvalue 

univRec. insert ( fieldID, lvalue ); 

case eFieldType_Double: 

if( P Accessor->GetFieldValue ( fieldID, dValue 

univRec. insert ( fieldID, dValue ); 

break; 



HRESULT CBaseAOSTableOCI : : InsertRecord ( Mappingltem theMap [ ] , int 
numFields, CDataAccessor *plnsertltem, CFlItemUniversal *pUnivItem, bool 
bForceCreate ) 
{ 

bool bHasData = SetRecordFields ( theMap, numFields, plnsertltem, 
pUnivItem ) ; 

iff bHasData || bForceCreate ) 

{ 

pInsertItem->InsertRow(0) ; 
pInsertItem->Exec ( ) ; 

} 

return S_OK; 

} 

/* 
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* Function: SetRecordFields 

* Description: Map fields from an UniversalRecord format into an 
Oracle database record (plnsertltem) 

*/ 

bool CBaseAOSTableOCI :: SetRecordFields ( Mappingltem theMap[], int 
numFields, CDataAccessor *plnsertltem, CFlItemUniversal *pUniv!tem ) 



int inx=0; inx<numFields ; inx++ ) 
enumFieldTag fieldID = theMap [inx] .m_universalFieldID; 
BOOL bExists = pUnivItem->m_record.Find ( fieldID, field ); 

if( bExists ) 

{ 



{ 

string blob = f ield. getBlob ( ) ; 
LPCTSTR szErrtailAddr = 
GetAddressFromRecipients ( (F1RECIPIENTS* ) blob . c_str ( ) ) ; 

iff szEmailAddr && *szEmailAddr != NULL ) 
pInsertItem->SetFieldValue ( fieldID, 



(string) szEmailAddr ) ; 



else 



else iff field. isStringf) ) 

string sValue = field . getstring () ; 
iff ! sValue. empty { ) ) 

p!nsertItem->SetFieldValue { fieldID, 



else iff field. isLong ( ) ) 



LONG nValue = f ield . getLong ( ) ; 

plnsertltem- >SetFieldValue ( fieldID, nValue) ; 



else iff field. isDatef) ) 

field. getDate () ; 



DATE dValue = 
iff dValue ) 
Plnsei 



->SetFieldValue ( fieldID, 



} //iff bExists ) 

} // For all fields 



return bHasData; 



While the above-identified code is specific to, for example, an Oracle 
database, one of average skill in the art will readily recognize that the 
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technique utilized above may be adapted to other types of databases 
containing records and fields of interest. In the above code examples, all 
fields which are mapped from a particular application are mapped to fields in 
the master mapping file. 

5 

Management Server 

In order to provide security and identification of particular users in an 
Internet-implemented synchronization system, a management server may be 
provided in the system of the present invention. The management server is 

10 a centralized server which controls behavior and characteristics of the entire 
network of device engines across all users. 

Figure 14 shows the general representation of how a management 
server 1 41 0 integrates itself into the system of the present invention. Shown 
in Figure 14 is an exemplary device engine 1450 which has HTTP links to 

1 5 both a management server 1 41 0, a storage server 1 41 5, and a generic FTP 
server 1420. As will be discussed hereinafter with reference to the process 
of the present invention, and the specific implementation of the data below 
shown in Figures 15-17, the management server interacts with the device 
engine to control authorized access to information on the storage server, or 

20 a generic FTP server 1420,1425 to access device-specific information 
storage 1430 in accordance with the system of the present invention. This 
allows any device coupling to the Internet to have access to management 
protocols and to retain user information across all platforms which the data 
which is being synched by the system of the present invention must access. 

25 The management server communicates using hypertext transfer 

protocol (HTTP) which may be implemented with a secure sockets layer 
(SSL) to ensure security. 

In particular, the management server supports an authentication 
interface that requires each device engine to authenticate with the 

30 management server before performing synchronization. Certain storage 
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server implementations may utilize locking semantics to control read and 
write access to storage for multiple device engines. For example, in a 
generic FTP request, if two device engines attempt to connect to the same 
data at the same time, there must be some form of locking control to prevent 
5 device engines accessing the same data at the same time. In this instance, 
the management server controls the device engine acquisition, renewal, and 
releasing of locks against data stored in the network. 

Each device engine is uniquely identified and tracked by the 
management server. This allows for tailoring behavior between the 

1 0 management server and specific types of storage systems and device engine 
components. All device engine components are tagged and version stamped 
for management via the management server. 

Device actions can request updated copies of individual device engine 
components, permitting self-update and configuration of device engine 

1 5 systems. This permits minimal download designs for device engines that are 
on low bandwidth connections enabling the device engines to download 
additional required components at a later time. 

In a further aspect of the system, a value added component may be 
provided where the management server can support client's advertising 

20 mechanisms, enabling the display of banner or similar advertising on a 
device engine system without the need for a web browser. Cycling of 
advertisements, statistic collection, and the like, are managed via 
management server protocols. Online purchase and subscription 
mechanisms are also supported using the management server protocol. 

25 The management server further supports the accounting, sign-up 

registration, device edition, storage server selection, and similar functions for 
each user in the system. In one embodiment, the management server may 
retain password and encryption information for a given user account. In a 
second embodiment, such information is not retained. The second 

30 embodiment provides the advantage that users may feel more secure if the 
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maintainer of the management server is not in possession of the password 
to access data in the user's account. 

Further information with respect to the management server and the 
data flow from the management server to other components of the system of 
the present invention will become apparent with respect to the discussion of 
the process flow and data flow diagrams in Figures 15-17. 

Figure 1 7 shows a general depiction of the dataflow and the functional 
specification of the management server utilized in accordance with the 
present invention. 

As shown in Figure 17, following a welcome request 1710, a user is 
allowed to sign out which enables an add user module 1712, and 
subsequently enables an add device module 1714. If sign-up is not 
requested, information may be provided via module 1718. 

As indicated in Figure 17, the add user module 1712 adds user 
records to the user in device database 1750. Additionally, the add device 
module 1714 adds users and devices to the user device database 1750. A 
device list 1720, and a device engine download and update database 1722, 
provide selection data for the add device module 1714. The account 
authentication module 1724 receives input both directly from a user log-in 
from the welcome screen at 1710 and from the add device module 1714. 

Once an account is authenticated and confirmed, the administrator of 
the system of the present invention having a private data store at 1 770 may 
choose to provide a web desktop 1754 which allows access to a user's 
records such as file 1756, e-mail 1758, calendar 1760, contacts 1762, notes 
1764, and tasks 1766. The information will be culled from a provider 
database 1752 which will be synched in accordance with the system of the 
present invention as previously described. In essence, the provider database 
1752 accesses data from the device engines 1780, which include, as 
discussed above, the storage server, each individual device engine 1785, 
and a settings database 1787. 
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Other portions of the management server include the locking modules 
for beginning a sync 1 732, continuing a sync 1 734, and ending a sync 1 736, 
and for updating user information including modifying a user 1742, adding 
devices 1744, removing devices 1746, and modifying devices 1748. 

5 

Storage Server 

Shown in Figure 14 is the storage server 1415. While storage server 
1415 may include a generic storage model accessible through any number 
of standard Internet protocols, in accordance with the present invention, a 

10 flexible storage architecture is provided that permits various standard 
implementations of the system of the present invention. This allows 
deployment of network services without instal lation of new server appl ications 
and can be responsible for communicating change information between 
multiple device engines in a consistent fashion. 

15 One or more storage servers 1415 may be used to communicate 

transaction amongst a collection of devices. Each user's personal 
information network is represented by a unique account within its own data 
package storage section. The storage server 1415 maintains persistent store 
collection of data packages which is, at a minimum, enough data packages 

20 to be capable of synchronizing the most out-of-date system in a user's given 
information network or add information to new devices which are provided in 
the network. Additional data packages can be maintained to permit rollback 
of previous versions of information. The storage server can automatically 
dispose of older data package storage and can support aging of an inactive 

25 accounts. 

Each storage server 1415 may be implemented using a variety of 
implementations including a standard FTP server for any operating system 
platform. The storage server can be implemented using HTTP protocols for 
increased efficiency and firewall avoidance. The storage server may be 

30 implemented using techniques for local storage such as database access or 
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single file storage of a user's entire file system tree. The storage server 1 41 5 
may utilize the stored foreign protocol model for moving copies of data 
packages to other storage servers in the system. In one embodiment, the 
storage server can allow tunneling of information using an alternative 
5 protocol to other storage servers in cases where firewall prevents originating 
protocol. For example, a storage server can relay an FTP traffic inside an 
HTTP protocol. Storage servers may include their own locking semantics to 
arbitrate multiple device engine access to the same server without the need 
for a separate management server. Each device engine can access only a 

10 specific user's data package storage area even though the storage server 
1415 may maintain a larger number of data packages across a large number 
of users. This allows for increased scaling when the storage server is 
implemented using file system techniques. 

In one aspect, the storage server is implemented using standard FTP 

15 or HTTP connections for each operation. HTTP is composed of request 
response pairs. All requests are supposed to be posting commands. 
Parameters can be set in the form known as "application/X-WWW-form- 
URLENCODED". The encoding is specified as in RFC1866. Functions for 
the storage server include testing if the storage server can reach other users 

20 which will retrieve a simple text string, a "get" command which transfers the 
contents of a file as in a binary stream of byes; a put command as a binary 
stream of data to the storage server, a directory listing command, a remove 
command, a rename command, an exist command, and the like. 

25 Pull Synchronization 

Figure 15 represents a "pull" synchronization process in accordance 
with the present invention. Both the pull synchronization illustrated in Figure 
15 and the push synchronization illustrated in Figure 16 are done from the 
perspective of the device engine. 

30 A pull synchronization as illustrated in Figure 1 5 is always performed 
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prior to a push synchronization. This allows the device engine to know 
whether synchronization of its own data is necessary. 

Each device has its own triggering mechanism for initiating 
synchronization. Some devices, such as Windows clients and Palm® pilots 
5 are triggered manually when the user presses a "sync" button. Other 
devices, such as a cellular telephone, may be triggered automatically after 
another device completes a sync. Regular, time-based triggers are 
supported as well. A web-based application portal will sync when a user logs 
into the website security authorization mechanism, and may optionally sync 

10 on a log-out of the user or on the session time-out, but only if the user has 
changed data during the session. 

For each sync, the triggering event specifies which application types 
are to sync for the device. This enables a triggering event to trigger only a 
sync for a particular application type. The management server can specify 

1 5 that no sync is needed for a particular type of application to minimize traffic 
to the storage server. Syncs may be triggered via an HTTP request to the 
server. This request holds information about which device to sync and the 
user log-in information is bounced to the management server for 
authorization and validation. Syncs may be triggered by sending an HTTP 

20 request to the server and passing the authentication information in the data 
portion of the request to the management server. Each device may include 
a servlet that is responsible for retrieving the request and ensuring its proper 
format before passing the synchronization request on to the server. 

The device name and device class uniquely identify a particular device 

25 type that is being synchronized, and is contained in the management server. 
Each user has one or more device entries in the management server 
authorization records and each device name is unique for this user's space. 
For example, if a user has five devices with his or her own personal 
identification number, there will be five authorization records. There may be 

30 two Windows devices, two different Palm® devices and a web service portal, 
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each having their own personal identification number. 

As shown in Figure 15, the pull synchronization process starts at an 
idle state 1405 when the triggering event, described above, triggers a 
synchronization request. The synchronization request is confirmed at 1410 
5 and if the request is verified, a connection is made to the storage server at 
step 1415. Once a connection is established, the connection to the 
management server is made at step 1420 to authenticate the user 
identification via the management server. If authentication is successful, the 
management server may initiate a management server lock on the storage 
1 0 server so that no conflicting device engines may couple to the same data at 
the same time. A failure at any of the steps 1410-1425 will return the system 
to its idle state 1405. Once the engine server lock is acquired, the storage 
server will be checked to determine whether a new version of the data exists 
on the storage server at step 1430. If no new version exists, the 
1 5 synchronization process ends. 

If a new version of the data exists, the device engine will retrieve the 
difference information at step 1435 "to get A." 

Once a A is retrieved, conflicts are resolved at step 1 450. The resolve 
conflicts step allows a user to resolve conflicts to multiple types of data which 
20 have been changed on both the server portion of the device and in the local 
data. 

Once the conflicts have been resolved at step 1450, the A's are 
applied at step 1455. The apply A step 1455 allows for filters and mappings 
to be accounted for on the local device engine side of the system. As shown 

25 at steps 1460, 1465, 1470, and 1475, the A may include updates at the item 
level 1460, application level 1465, device level 1470, or network level 1475. 
In each of the aforementioned steps, a loop back to the A retrieval step 1 435 
is provided. When no further A's are available, the management server lock 
is released at step 1440. 

30 The foregoing description of a pull synchronization is further described 
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in the following pseudo-code: 

*SymbolicSyncEngine: : Sync 

Download Remote File System 

For each Symbolic app in the file system's list of symbolic apps 
CFDESymbolicSyncEngine : : SyncSymbolicApp 

Create a structured delta object -- CStructuredDelta 

delta (.. .) 

Compare local and remote versions of deltas SODs) , 

if not the same then 

while localVersion != remoteVersion 

download remote version 

// apply delta (change log) 
delta . ApplyChangeLog 
// See details below 

increment local version 

end while 

else 

nothing to do 

end if 

if any local items (change logs) are unsent then 
delta- >ApplyUnsentItems (Reads the changes 

[JCL where applied?] 

end if 

// Generate a new change log for the device: 
delta->delta. GenerateChangeLog ( . . . strChangeLogFile 
...) // See details below 

FTP it back up to Storage Server 

Update the local version number 

end // SymbolicSyncEngine: : SyncSymbolicApp 

end // CFDESymbolicSyncEngine: : Sync 

CStructuredDelta : : ApplyChangeLog 

Set up m_pAppObj; // IFAO pointer 

Set up m_pAOS; // IAOS pointer 

Other set up (statistics, time to complete, etc.) 

Read the change log and . . . 

ApplyChangeListToAOS (flChanges) 
for each itme in list 

ApplyltemToAOS // (Does 
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end // ApplyChangeListToAOS 

If not doing a full sync, also add changes from this file to 
apply these to m_FlChanges 

end //CStructuredDelta: : ApplyChangeLog 

CStructuredDelta: : GenerateChangeLog 

Set up m_pAppObj ; // IFAO pointer 

Set up m_pAOS; // IAOS pointer 

Other set up (statistics, time to complete, etc.) 

// Set up m_deviceChanges by call to: 
CStructuredDelta: : CreateDeviceChangeList 

Create a CFlItem* pltem 

// Iterate FAO modifications: 
for (m_pAppObj->GetFirstModified (pltem) , 
m_pAppObj->GetNextModified (pltem) ) 

cast pltem to — > CFlItemUniversal* pUniltem 

// Do certain things based on whether the operati 
is an add, delete, or update. 

// Then in each case, call: 

CStructuredDelta: : GetMatchingltemFromAOS 

// First get by F1ID 
m_pAOS->GetRecordByFHD 

// See if we have an AppID, if so: 
m_pAOS->GetRecordByAppID 



// If we can build search key on it 
iterate m_pAOS->GetFirstMatchingRecord 

/ m_pAOS->GetNextMatchingRecord 
end // 

CStructuredDelta : : GetMatchingltemFromAOS 
end for 

end // CStructuredDelta: : CreateDeviceChangeList 

if m_deviceChanges is not empty 

// reconcile (compare) change lists while writing to AOS 
CStructuredDelta: : ReconcileChangeLists 

For each item in m_deviceChanges . . . 

If we can find it in m_FlChanges 

Reconcile the device item and the fl 

item 

end if 

ApplyltemToAOS // (Does 
m_pAOS. . .AddRecord/UpdateRecord/DeleteRecord) 
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end // CStructuredDelta: : ReconcileChangeLists 

// Create a new change log (Fl delta package) 
5 ApplyChangeListToFl (m_deviceChanges ) 

m_deviceChange . Store 

// Fires off its own whole world, see 

FlItemList. cpp 
^ end // m_deviceChange. Store 

end // ApplyChangeListToFl (m_deviceChanges) 

report stats 

15 end if 

// Switch (SyncMode) 
If SyncMode == full 

ApplyAOSToDevice 
20 iterate 

m_pAOS->GetFirstRecord. . .m_pAOS->GetNextRecord 

Add or update the corresponding FAO rec 
(Note. Never delete based on what's in AOS, apparently), 
end / / ApplyAOSToDevied 

25 else 

ApplyChangeListToDevice (m_f IChanges ) ; 



30 



End // CStructuredDelta: : GenerateChangeLog 



Push Synchronization 

Figure 16 shows a push synchronization in accordance with the 
system and method of the present invention. Beginning at idle state 1505, 
a synchronization event occurs and if confirmed at step 1510, A's are 
35 checked at step 1515. Depending on which type of changes occurred, a 
network A 1520, device A 1525, location A 1530, or item A 1535 will be 
created. 

Once the A's for a given application have been created, the method 
of the present invention continues at step 1 540, which enables a connection 
40 to a storage server. Upon connection to the storage server, a further 
connection to management server 1 545 will occur to authenticate the user in 
the system. Failure at any of the aforementioned points will result in 
returning to idle state 1 505. Upon authentication, a management server lock 
is enabled to ensure that multiple device engines do not connect to the same 
45 data at the same time. 

Once a lock is acquired at step 1 555, A's are uploaded to the system. 
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As shown, this may include uploading an item A 1 575, an application A 1 570, 
uploading a device A 1565, or a network A 1560. Once A's have been 
uploaded to the server, management lock server 1580 is released, and the 
connection to the storage server is terminated at step 1585. 

It should be recognized that such a push synchronization need not 
occur directly to a server, but may occur directly to a second device engine 
in accordance with the depiction of the multiple embodiments of the invention 
in Figures 1-7. 

Data Package Specification 

Once information is provided into the universal data format, the device 
engine organizes the format into a data package. Each data package thus 
includes a description of changes to any and all information for particular 
application, and a collection of data packages describes changes across all 
device engines including all different types of data. With encoding and 
compression, data packages can become very compact to minimize 
bandwidth and storage requirements across the system of the present 
invention. 

In one particular aspect of the present invention, encoding of the data 
packages may be provided in a streaming format to allow processing by the 
device engines with minimal storage and memory configuration at the device 
engine level. 

The device engine can read the stream and determine which records 
from which applications it needs to update the particular information present 
on the system on which it resides. 

Data packages can be provided in a binary data format. This allows 
data packages to encode changes to non-application data at a bite level. 
Hence, if a single bit on a system changes, the system of the present 
invention allows synchronization of that bit on another system. Changes are 
described as a sequence of bite-level change operations. One such 
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encoding is using a sequence of insert and copy operations. Insert and copy 
operations generally define a particular "insertion" of a number of bites from 
a source file, then how many bites of a changed source file must be inserted 
to a particular file, then how many bites to insert from a particular new file, 
with a differencing engine taking the bites in the stream and inserting them 
into the new file to create the new version of the file. 

As will be readily understood by one of average skill in the art, this 
allows a user to, for example, change a binary file such as a word processing 
document or other type of attachment, and synchronize such an attachment 
at the binary level. Specifically, if one forwards an e-mail of a word document 
to a second individual, the second individual modifies it and wishes to return 
this document with modifications to the first individual, because the first 
individual has the original file on his system, if both systems are enabled in 
the system of the present invention, the second system need only send the 
changes or the difference information back to the first system in order for the 
first system to reconstruct the document on the second system using this 
change data to create the document as intended by the second user. 

Multiple caching of both the generation and application of data 
packages can be utilized to deal with communication issues in accordance 
with the system of the present invention. It should be further recognized that 
data packages can be merged into larger meta-data packages. Such meta- 
data information, such as the organization of multiple device packages, may 
be encoded into a larger system package. Each system package is 
essentially an encoded sequence of data packages. 

Figure 12 shows the general format of the data package and universal 
data format an object stream hierarchy used in accordance with the present 
invention. With reference to Figures 1 1 and 12, one will note that each item 
in a particular application data structure will have a particular classification, 
such as a file, folder, contact, e-mail, calendar, etc. as shown in Figure 13. 
The universal data structure contains a mapped item field for each type of 
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data possible from each application supported by the system. Hence a 
"master" list of every data field mapping possible will contain a large number 
of items. Each application object requires a subset of such fields. One 
exception is an application object used for a Web portal application which 
provides access to all information available on all devices, including other 
Web portals. 

Particular examples of item fields 1 260 which may be included for any 
given item 1250 are shown in Figure 13. These exemplary item objects may, 
for example, be from an allocation such as Microsoft Outlook. Outlook allows 
for note items 1310, e-mai I items 1 320, task items 1 330, calendar items 1 340, 
bookmark items 1 350, f i le items 1 360, channel items 1 370, folder items 1 380, 
and contact items 1390, all of which have fields such as those represented 
in Figure 13. 

The data format also contains folder information 1 240 which allows the 
classification of items and consequently their associated item fields into 
particular categories. 

Application objects 1230 include information on the types of 
applications from which information in the stream is included. Device objects 
1220 include information on the origin type of device which the information 
is originating from. Network objects 1210 include information on a user level 
to define that the information in the data stream is coming from a particular 
user. 

As detailed above, each application object supports a folder store 
interface that permits management of collections of information on a folder 
level, and permits management of folder hierarchies of information. The 
application object also includes an item interface that permits management 
of individual information entries such as records or files or components of 
information entries such as fields within records. Each application object 
further supports an interface for detection of a vendor application. 

A DataPack essentially contains a sequence of transactions describing 
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changes to information. This information can span two basic types: 
structured or application data, and unstructured or binary file data. 

Transactions are encoded using an efficient streaming format with tags 
to represent the actual content objects. This technique permits the 
5 continuous extension of the DataPack format as new content is supported. 

The general architecture of the package provides for transactions, 
application data, file data, files, objects and identifiers to be carried in the 
data package. Generally, transactions, application data, file data, and files 
have previously been described. 

10 The first portion of the data package will be the data package 

identifier. Each transaction has a basic architecture of objects and 
operations. Each piece of content is referred to as an object and is uniquely 
represented with a Universally Unique Identifier (UU ID). Objects typically are 
represented by a dynamically generated UUID, but more common objects are 

15 represented by static UUIDs. The following static UUIDs are defined: 



UUID_GenericDefa-ultFolder 
UUID_Def aultContactFolder 
UUID_DefaultInboxFolder 

20 UUID_DefaultOutboxFolder 
UUID_DefaultDraf tsFolder 
UUID_Def aultTrashFolder 
UUID_DefaultSentFolder 
UUID_DefaultCalendarFolder 

25 UUID_DefaultTaskFolder 
UUID_DefaultNoteFolder 
UUID_DefaultJournalFolder 
UUID_DefaultFavoriteFolder 
UUID_DefaultCookieFolder 

30 UUID_DefaultHistoryFolder 
UUID_DefaultChannel Folder 
UUID_DefaultFileFolder 
UUID_DefaultCallFolder 



Each UUID has a unique 128 bit value which may be assigned by the 
system provider. 

Transactions are broken down into manageable blocks in the form of 
individual files. These files are then optionally compressed and encrypted 
and prefixed with appropriate headers. Transactions are grouped into 
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specific files based on the following rules: 

• Transactions related to account information are grouped into a 
DataPack file. 

• Transactions related to a specific data class are grouped into 
a DataPack file. 

• Transactions referring to binary data are grouped into separate 
DataPack files for each file object. 

A DataPack file is identified using specific rules based on the file 
name. The file name is of the form "UUID.VER" where UUID is the identifier 
for the specific object and VER is the transaction version number. The 
version number is of the form "D0001" with additional digits used for large 
version numbers. The "D000" value may be reserved for the base version for 
the object. 

The UUID for the user account is generated by the Management 
Server (MS). The MS also maintains a current table of UUID values and 
version numbers that provides the root structure for understanding the 
DataPack files within a user account. The MS also provides necessary 
locking semantics needed to maintain consistency when multiple device 
engines attempt to synchronize. 

All DataPacks are prefixed with a standardized header that provides 
basic content information regarding the DataPack. Compression and 
encryption headers follow the DataPack header if needed. 

The data package header information will include version signature, 
applied versioning information, content type, A engine type, compression 
type, encryption type, applied size, encrypted size, compressed size, raw 
data size, and other data useful for the device engine in decrypting the data 
stream to provide the data into a format usable for the application. 

The header may optimally have the format: 
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Type 


Bytes 


Version 




Signature 


4 


Applied Version 


8 


ContentType 


4 


DeltaType 


4 


CompressionType 


4 


EncryptionType 


4 


AppliedSize 


4 


EncryptedSize 


4 


CompressedSize 


4 


RawSize 


4 


Reserved 


TBD 



15 The following ContentType values are permissible: 



Field 


Comment 


DP_CONTENT_RAW 


Raw 


DP_CONTENT_COMPRESSED 


Compressed 


D P_CO NTENT_E N C R YPTED 


Encrypted 



The DeltaType encodes the type of binary file differencing used. 
The following DeltaType values are permissible using 
DataPackageDeltaType: 

25 



30 



Field 


Comment 


PackageDeltaTypeUninitialized 


Uninitialized 


PackageDeltaTypeRawData 


Raw binary data 


PackageDeltaTypeDeltaXDelta 


Xdelta binary difference 


PackageDeltaTypeDeltaBDiff 


Bdiff binary difference 
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The compression type specifies whether the DataPack has been 
compressed. A DataPack compression header follows the DataPack 
header if a compression type is specified. The following CompressionType 
values are permissible using DataPackageCompressionType: 

5 



Field 


Comment 


PackageCompressionTypeUninitialized 


Uninitialized 


PackageCompressionTypeNone 


None 


PackageCompressionTypePK 


PKZip format 


PackageCompressionTypeLZS 


LZS format 



The encryption type specifies whether the DataPack has been 
encrypted. A DataPack encryption header follows the DataPack header 
if an encryption type is specified. The following EncryptionType values are 
15 permissible using DataPackageEncryptionType: 



Field 


Comment 


PackageEncryptionTypellninitialized 


Uninitialized 


PackageEncryptionTypeNone 


None 


PackageEncryptionTypeXORTest 


XOR masked data 


PackageEncryptionTypeBiowFish 


Blowfish 


PackageEncryptionTypeTwoFish 


Twofish 



Al I DataPack compression headers are encoded using the following 

25 format: 



Field 


Size (bytes) 


Comment 


Size 


4 


Size of data including this header 


Version 


4 


Version (1) 


Signature 


4 


Signature (4271) 


HeaderType 


4 


Header type (HeaderTypeCompression) 
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Reserved 


12 


Reserved 


Decom pressedSize 


4 


Decompressed size 


Reserved 


50 


Reserved 


Reserved 


12 


Reserved 



The following HeaderType values are permissible using 
DataPackageHeaderType: 



Field 


Comment 


HeaderTypeUninitialize 
d 


Uninitialized 


Heade rTypeEncryp t i on 


Encryption 
header 


He ade r Type C omp r e s s i on 


Compression 
header 


Heade rTypeRaw 


Raw header 



All DataPack encryption headers are encoded using the following 

format: 



25 



Field 


Size 
(bytes) 


Comment 


Size 


4 


Size of data including this 
header 


Version 


4 


Version (6) 


Signature 


4 


Signature (4270) 


HeaderType 


4 


Header type 
(HeaderTypeEncryption) 


Reserved 


12 


Reserved 


DecryptedSize 


4 


Decrypted size 


InitValue 


16 


TBD 
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KsyLs ncf t h 












Salt 


4 


TBD 


PadBytes 


4 


TBD 


HMAC 


20 


TBD 


Reserved 


12 


Reserved 



The data package transaction format may take a 
number of forms. One example is the following: 



DataPack transaction format - header - info - objects and operations 
Diagram 

transaction ::= fileData 1 Header + InfoList + TransactionList 

fileData::= raw binary file data | binary difference data 

Header ::= ID + DataPackID + DataPackVersion 
ID : := FUSE 
DataPackID ::= CLOG 

InfoList ::= FieldList 

TransactionList ::= Operation + [Itemlnfo + [FieldList]] 
Operation : := see table below 

Itemlnfo ::= ItemType + ItemFlags + EntrylD + ParentEntrylD 
ItemType ::= same as enuml temType 
ItemFlags ::= sane as enumTlItemFlags 

EntrylD : := UUID 
ParentEntrylD ::= UUID 

UUID ::= 12 8 -bit UUID as defined by standard 

FieldList ::= {FieldTag + FieldData} + ListEnd 
FieldTag ::= same as enumFieldTag 

FieldData ::= FieldDataType + [FieldDataLen + [FieldDataData] ] 
FieldDataType ::= see below 

FieldDataLen ::= length as required by FieldDataType 
FieldDataData : := data as required by FieldDataType 
ListEnd ::= DWORD (0) 

The following Operation values are permissible 
using the Operation class: 



Field 


Comment 


clNop 


None 


clAdd 


Add 


clDelete 


Delete 
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cl Change 


Change 


clMove 


Move 


cl Rename 


Rename 


clForceChan 
ge 


Force change without 
conflict 



The following FieldDataType values are permissible using 
cIDataType: 



10 



Field 


Comment 


cllnvalidType 


TBD 


cISt ring 


Unicode String bytes with a 32-bit length prefix 


clString8 


Unicode String bytes with an 8-bit length prefix 


clString16 


Unicode String bytes with a 16-bit length prefix 


cl Empty String 


TBD 


clBlob 


32-bit length followed by a byte stream 


clBlob8 


8-bit length followed by a byte stream 


clBIob16 


16-bit length followed by a byte stream 


clEmptyBlob 


TBD 


clByte 


8-bit value 


cIShort 


16-bit value 


cIDword 


32-bit value 


clQword 


64-bit value 


cIDate 


DATE type (double) 


cIDouble 


8 byte real 


cl Float 


4 byte real 


clUuid 


16 byte uuid 


clZero 


Zero value 


clOne 


One value 


clUnspecified 


Unspecified value 


cl Default 


Default value 


cICollection 


Collection with 32-bit length 
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cICollectionS 


Collection with 8-bit length 


cIColiection 16 


Collection with 16-bit length 


clEmptyCollection 


Collection with no length 



5 Data package objects are organized into a 

hierarchy as follows: 

Account: := DeviceList + DataClassList 
DeviceList: := {Device} 

DataClassList: := {DataClass} + ProviderList 
10 ProviderList: := {Provider} + DataStoreList 

DataStoreList: := {Folder} + ItemList 
ItemList : : = {Item} + FieldList 
FieldList::= {Field} 

15 An account is the root structure, which identifies 

information about the user's account. It may have 
exemplary field tags (eFieldTag_ [NAME] ) such as Name, 
Password, UserName and Version. The FieldTag ItemType 
value is specified as ItemType_PIN using enumltemType . 

20 A device is a system identified as part of an 

account. Examples include PCs, handhelds, Web sites, 
and so on. It may have tags (eFieldTag_ [Name] ) such 
as: "name" and "type" and item type values 
(eDevice_ [Name] ) such as Portal, Palm, Windows, 

25 CellPhone. 

A data class is a grouping of similar information 
types . Many data classes may be represented for a 
particular account. The data class may contain field 
tags (eFieldTag_ [Name] ) such as: Name; ItemType; 
30 SubType; IsManaged; Provider; Filter and Version. 

The following ItemType values are permissible 
using enumDataClass (eDataClass_ [Name] ) : 

Tag Description 
UNKNOWN Unknown 
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CONTACT 


Contact/address book 


EMAIL 


Electronic mail 


CALENDAR 


Calendar 


TASK 


Task/to do 


NOTE 


Note /memo 


JOURNAL 


Journal 


BROWSER 


Web browser favorites 


FILESET 


Collection of files 


PIN 


Account information 


DEVICE 


Device information 


FILEBODY 


Contents of file 



A Provider is the application that maintains 
specific information within a data class. There can be 

15 more than one provider for a particular data class. 
Field tags include: Name, AppObjID, Password, Username 
and Version. Examples of provider tags permissible for 
the provider (eProvider [Name] ) include: Portal, Palm®, 
Microsof tOutlook®, Lotus Organizer, Microsoft Internet 

20 Explorer, Microsoft Windows, and so on. 

Data stores are the containers for storing 
information within a provider. There can be more than 
one data store for a particular provider. Folders 
represent structural organization of information within 
25 a data store . Data stores are not required to support 
folders. Tags (eFieldTag_[Name]) supported for each data store 
include: Name, ItemType, IsManaged and OriginalPath. Item types 
permissible for the data store include: unknown; Folder; MAPI; Database 
and Store_File. 

30 Folders represent structural organization of information within a 

data store. Data stores are not required to support folders. A folder is 
represented by a UUID and may contain any of the following field tags 
(eFieldTagJNamej): Name; ItemType; IsManaged; FileAttributes; 
CreationDate; ModificationDate; AccessDate; Special FolderType. 
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The eFieldTagJtemType value is specified as eltemType_FOLDER 
using enumltemType. 

Items are individual informational components consisting of the 
actual user data. They may contain field tags such as: Name, ItemType, 
5 IsManaged, and Version. 

File items typically have the following additional field tags 
(eFieldTag_[Name]): 

FileAttributes 

CreationDate 
10 Modif icationDate 

AccessDate 

FileSize 

FileBody 

DeltaSize 
15 Hash 

Item types may take the format (eltemType_[Name]) and may 

include: extended; folder; attachment; contact; distlist; email; calendar; 

task; call; note; post; journal; form; script; rule; favorites; subscription; 
20 common_favorites; desktop; common_desktop; startmenu; 

common_startmenu; channels; cookies; programs; common_programs; 

startup; common_startup; sendto; recent; internet_cache; history; 

mapped_drives; printers; docs; doctemplates; fonts; window_settings; 

app_data_folder; app_settings; fileset; pin; device; data_store; file; 
25 provider; and data_class; internal. 

A field is based on one of a set of base type definitions. All field tag 
information is encoded using the following format: 



Field 


Size (bits) 


Comment 


FieldTag 


16 


Unique tag number 


FieldType 


6 


Field base type 


FieldSubType 


10 


Field sub-type 
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A number of Field types are possible, including: unknown; long; 
dword; date; string; binary; float; double; collection; uniqueid; qword; uuid; 
file; invalid. LONG is a four byte value encoded in big-endian format. 
FieldType DWORD is a four byte value encoded in big-endian format. 
5 FieldType String is a sequence of Unicode characters followed by a single 
NULL byte. Interfaces are provided with an MBCS value. FieldType 
Binary is a sequence of bytes. FieldType UniquelD is a sequence of bytes 
as defined by the Universally Unique Identifier (UUID) standard. AO 
interfaces are provided with a Locally Unique Identifier (LUID) value 
10 FieldType QWORD is an eight byte value encoded in big-endian format. 
FieldType File is a UUID that references a separate DataPack containing 
the file body data. AO interfaces are provided with a sequence of Unicode 
characters followed by a single NULL byte that describes the full path 
name for the file. 

15 Any number of filed sub types are possible. Each of the sub-types 

includes all of the possible data types from all of the supported user 
applications. As should be well understood, the possibilities in the number 
of sub-types is quite large, and dynamic as each new application 
supported by the system of the present invention is added. Examples of 

20 sub-types include: 

SubField Description Description 

Base No sub-type specified 

EmailAddress Email address 

EmailAddressList Email address list 

25 SearchKey Search key 

CategoryList Category list 

StringList String list 

DistributionList Distribution list 

Gender Gender (enumGender) 

30 TimeZone Time zone ( enumT ime Zone ) 

Boolean Boolean (TBD) 
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NonZeroBool 

Priority- 
Sensitivity 
Importance 
SelectedMailingAddr 

TaskStatus 

FlagStatus 

RecurrenceType 

DayOfWeek 

DayOfMonth 

Ins tanceOf Month 

MonthOfYear 

BusyStatus 

AttachmentType 

MailBodyType 

RGB 

ManagedState 
Faold 

Special Folder Type 

Respons estate 

Responses tatus 

Journal Status 

PageStyle 

PageNumberMethod 

DelegationState 

Meetings tatus 

Meetinglnvitation 

CalendarType 

DateOnly 

TimeOnly 

PhoneMumber 

URL 

FilePath 
PopMessagelD 
MIMEType 
INVALID 



Boolean with non-zero value 
( enumNonZeroBool ) 

Sensitivity (enumSensitivity) 

Importance (enumlmportance) 

Selected mailing address 
( enumS e 1 e c t e dMai 1 i ngAddr ) 

Task status (enumTaskStatus) 

Flag status (enumFlagStatus ) 

Recurrence type (enumRecurrenceType ) 

Day of week (enumDayOfWeek) 

Day of month (1 through 31) 

Instance of month 

( enumlnstanceOf Month) 

Month of year (enumMonthOfYear) 

Busy status (enumBusyStatus ) 

Attachment type (enuitiAttachmentType) 

Mail body type ( enumMailBodyType ) 

RGB color value 

Managed state (enumManagedState) 

FAO ID for provider 

Special folder type 
(enumSpecialFolderType) 

Response state (TBD) 

Response status (TBD) 

Journal status 

Page style 

Page number method 

Delegation state 

Meeting status 

Meeting invitation 

Calendar type 

Date only 

Time only 

Phone number 

URL 

File path 

POP message ID 

MIME type 

All values must be below this 



The aforementioned invention provides a user-centric model of 
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communication to deliver personal information via network services. This 
model accommodates devices that are disconnected from the network, 
such as the Internet, at various times. Personal information can continue 
to exist locally rather than imposing a server-centric model on existing 
5 information. 

In accordance with the foregoing, a store and forward information 
broadcast is utilized. Changes to existing information are replicated to an 
Internet storage server and changes are then retrieved by other devices 
on the network at device-specific times. In this manner, direct client 
10 communication is accomplished without requiring one-to-one 
communication. While one communication is supported by the system of 
the present invention, it need not be required. 

Although the present invention has been presented in the form of 
an Internet store and forward broadcast for the purposes of synchronizing 

15 personal information amongst various types of devices, it will be readily 
recognized that synchronization need not be accomplished as the only 
application for the aforementioned system. In particular, the system can 
be utilized to efficiently broadcast changes to information in so-called 
"push" type information applications where only portions of the data need 

20 to be changed on a client application. For example, in a system where 
information such as changes in a stock price need to be broadcast to a 
plurality of users, a client application implementing the aforementioned 
technology can be updated by only changing specific portions of the data 
in the client application relative to that particular stock price. This can be 

25 done using a smaller bandwidth than has previously been determined with 
other devices. 

The many objects and advantages of the present invention will be 
readily apparent to one of average skill in the art. All such objects and 
advantages are intended to be within the scope of the invention as defined 
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by the written description and drawings presented herein. 
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CLAIMS 

What is claimed is: 

1 1. An system for synchronizing data between a first system and 

2 a second system, comprising: 

3 a first sync engine on the first system interfacing with data on the 

4 first system to provide difference information; 

5 a data store coupled to network and in communication with the first 

6 and second systems; and 

7 a second sync engine on the second system coupled to receive the 

8 difference information from the data store via the network, and interfacing 

9 with data on the second system to update said data on the second system 
10 with said difference information. 

1 2. The apparatus of claim 1 wherein the first system and second 

2 system are coupled to the server via a private network. 

1 3. The apparatus of claim 1 wherein the first system and second 

2 system are coupled to the server via an Internet connection. 

1 4. The apparatus of claim 1 wherein the difference information 

2 is transmitted to the data store by the first sync engine and received from 

3 the data store from the second sync engine. 

1 5. The apparatus of claim 4 wherein the difference information 

2 is transmitted to the data store at a first point in time, and received from the 

3 data store at a second, subsequent point in time. 
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1 6. The apparatus of claim 1 wherein said second sync engine 

2 interfaces with said data on the second system to provide second 

3 difference information to the data store. 

1 7. The apparatus of claim 6 wherein the first sync engine 

2 couples to the data store to retrieve the second difference information and 

3 interfaces with the data on the first system to update said data on the first 

4 system with said second difference information. 

1 8. The apparatus of claim 1 further including a management 

2 server coupled to the network and in communication with the first sync 

3 engine, the second sync engine and the data store. 

1 9. The apparatus of claim 8 wherein said management server 

2 authorizes access of difference information on the data store by the first 

3 and second sync engines. 

1 1 0. The apparatus of claim 8 wherein said management server 

2 locks access to difference information on the data store during 

3 communication with the first and the second sync engines. 

1 11. The apparatus of claim 1 further including a first device, 

2 coupled to the first system via the network, providing said data to the first 

3 system. 

1 1 2. The apparatus of claim 1 1 wherein the first system is a sync 
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2 server. 

1 13. The apparatus of claim 11 wherein said data comprises 

2 changes to a previous state of the data, and said difference information 

3 comprises said changes in an encoded, universal format. 

1 14. The apparatus of claim 1 wherein said sync engine 

2 comprises: 

3 a data interface; 

4 a copy of a previous state of said data; and 

5 a difference transaction generator. 

1 15. The apparatus of claim 1 wherein said data on said first 

2 system comprises application data having a plurality of application specific 

3 formats, and said difference information is provided for each of said 

4 formats in a universal format to said data store. 



1 16. The apparatus of claim 1 further including: 

2 a plurality of sync engines on a respective plurality of systems, each 

3 of said plurality of engines being coupled to receive difference information 

4 from each of said first, second and plurality of sync engines from the data 

5 store via the network, and each said engine interfacing with data on the 

6 system on which it resides to update said data on said system on which it 

7 resides with said difference information, and interface with data on said 

8 system on which it resides to provide difference data information from the 

9 system on which it resides to the data store. 
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1 17. A system, comprising: 

2 a first device including at least a first data file and first differencing 

3 code having an input and an output coupled to a network to receive first 

4 device data change transactions, based on said at least one data file, from 

5 and provide change transactions to, said network; 

6 a data store coupled to the network having at least one data 

7 structure coupled to store change transactions; and 

8 a second system including at least a second data file and second 

9 differencing code having an input and an output coupled to the network to 

1 0 receive said first device data change transactions, and provide second 

1 1 change transactions based on said at least second data file to said data 

1 2 store. 

1 18. The apparatus of claim 17 wherein the first device and 

2 second device are coupled to the data store via an Internet connection. 

1 19. The apparatus of claim 17 wherein the first change 

2 transactions are transmitted to the data store by the first device at a first 

3 point in time and received from the data store by the second device at a 

4 second, subsequent point in time. 

1 20. The apparatus of claim 1 7 wherein the first differencing code 

2 receives second change transactions from the data store to and interfaces 

3 with at least the first data file on to update said data with said second 

4 change transactions. 

1 21 . The apparatus of claim 17 further including a management 



Attorney Docket No.: FUSN1-01002US0 
Iev/fusn1/1 002.001 .wpd 



-83- 

2 server coupled to the network and in communication with the first sync 

3 engine, the second sync engine and the data store. 

1 22. The apparatus of claim 1 7 wherein said management server 

2 authorizes access of difference information on the data store by the first 

3 and second differencing code. 

1 23. The apparatus of claim 1 7 wherein the first device is a sync 

2 server. 

1 24. The apparatus of claim 17 wherein said differencing code 

2 comprises: 

3 an application object; 

4 an application object store; and 

5 a delta engine. 

1 25. A method for synchronizing at least a first and a second 

2 resident on a first and a second systems, respectively, coupled to the 

3 Internet, respectively, comprising: 

4 determining difference data resulting from changes to the first file 

5 on the first system; 

6 transmitting the difference data to a server via the Internet; 

7 querying the server from a second system to determine whether 

8 difference data exists for files on the second system; 

9 retrieving the difference data to the second system; and 

1 0 updating the second file on the second system with the difference 
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1 1 data. 

1 26. The method of claim 25 wherein said step of determining 

2 comprises: 

3 comparing a current instance of the first file to a stored instance of 

4 the first file; and 

5 generating said difference data. 

1 27. The method of claim 25 wherein said step of querying 

2 comprises: 

3 coupling to a management server which provides information on a 

4 state of said difference data for files on the first system and the second 

5 system. 

1 28. The method of claim 25 wherein said step of retrieving 

2 comprises: 

3 coupling to the management server; 

4 receiving authorization from the management server to retrieve the 

5 difference data; 

6 transmitting a request to the server for the difference data; and 

7 receiving the difference data in response to the request. 

1 29. The method of claim 28 wherein the management server 

2 locks the server from receiving further requests for the difference data 

3 during said retrieving step. 
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1 30. The method of claim 25 wherein said step of updating 

2 comprises: 

3 applying the difference data to a stored instance of the second file 

4 on the second system. 

1 31 . An Internet synchronization system, comprising: 

2 a storage server having an Internet connection; 

3 a first device coupled to the Internet and including a device sync 

4 engine; and 

5 a second device coupled to the Internet and including a second 

6 device sync engine. 

1 32. The Internet synchronization system of claim 31 further 

2 including: 

3 a management server. 

1 33. The Internet synchronization system of claim 32 wherein the 

2 storage server and the management server are provided in a data center. 

1 34. The Internet synchronization system of claim 31 wherein 

2 communications between the first device, the second device and the 

3 storage server are encoded and compressed. 

1 35. The Internet synchronization system of claim 31 wherein data 

2 transfer between the first device, the second device and the storage server 

3 comprises difference transactions. 
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1 36. The Internet synchronization system of claim 31 wherein 

2 each device includes applications having data in an application specific 

3 format, and wherein communication between the first device, the second 

4 device and the storage server include changes to said data in an 

5 application independent format. 



1 37. The Internet synchronization system of claim 31 wherein 

2 each device sync engine comprises: 

3 an application object; 

4 an application object store; and 

5 a delta engine. 
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ABSTRACT 

A system and method for synchronizing devices which can couple 
to the Internet, or any network. In one aspect a system for synchronizing 
data between a first system and a second system is provided. The system 
includes a first sync engine on the first system interfacing with data on the 
first system to provide difference information. A data store is coupled to 
network and in communication with the first and second systems. A 
second sync engine is provided on the second system coupled to receive 
the difference information from the data store via the network, and 
interfacing with data on the second system to update said data on the 
second system with said difference information. 

Difference information is transmitted to the data store by the first 
sync engine and received from the data store from the second sync 
engine. The system may include a management server coupled to the 
network and in communication with the first sync engine, the second sync 
engine and the data store. The system may include a plurality of sync 
engines on a respective plurality of systems, each of said plurality of 
engines being coupled to receive difference information from each of said 
first, second and plurality of sync engines from the data store via the 
network. Each said engine interfaces with data on the system on which it 
resides to update said data on said system on which it resides with said 
difference information, and interfaces with data on said system on which 
it resides to provide difference data information from the system on which 
it resides to the data store. 

In a further embodiment, the invention comprises a method for 
synchronizing at least a first file and a second file resident on a first and 
a second systems, respectively, coupled to the Internet, respectively. The 
method includes the steps of: determining difference data resulting from 
changes to the first file on the first system; transmitting the difference data 
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to a server via the Internet; querying the server from a second system to 
determine whether difference data exists for files on the second system; 
retrieving the difference data to the second system; and updating the 
second file on the second system with the difference data. 
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Pull Synchronization 




Figure 16 
Push Synchronization 




Figure 
17 




